Data Engineer

Company: Syndicatebleu
Location: Bristol
Posted on: January 16, 2022

Job Description:

An Entertainment Company is looking for a Data Engineer to join their team on a temporary basis, ASAP. This will be a remote role.

Responsibilities:
Collaborate with product teams, data analysts and data scientists to design and build data-forward solutions.
Design, build, and deploy streaming and batch data pipelines capable of processing and storing petabytes of data quickly and reliably.
Help build and maintain foundational data products such as but not limited to Various conformed datasets, Consumer 360, data marts, etc.
Ensure data quality by implementing re-usable data quality frameworks.
Build and maintain dimensional data warehouses in support of business intelligence tools.
Develop data catalogs and data validations to ensure clarity and correctness of key business metrics.
Coach data engineers best practices and technical concepts of building large scale data platforms

Qualifications:
Minimum 3 years of data engineering experience, and 3+ years of experience architecting, designing, developing and implementing cloud solutions on AWS platforms.
Experience in a range of common big data tools & technologies such as Airflow, Hive, Nifi, Snowflake, Kafka, Spark etc.
Expert level knowledge in at least one programming language such as Scala, Java, Python or similar.
Basic SQL knowledge and experience working with relational databases/working familiarity with a variety of databases.
Experience in working with large datasets (Terabytes or more).
AWS Certifications are a plus.
Familiarity with binary data serialization formats such as Parquet, Avro, and ORC.
Prior experience building internet scale platforms which handle Peta-byte scale data and operationalizing clusters with hundreds of compute nodes in cloud environments preferred.
Expertise in Data governance and Data quality preferred.
Experience in operationalizing Machine Learning workflows to scale preferred.
Experience with open-source Big Data technologies such as Spark, Kafka, Druid, and Kubernetes preferred.
Proficiency with agile development methodologies preferred.

Please submit a resume for consideration.

You can use www.workgrades.com to collect and manage your references for free and share them with us or anyone else you choose. Candidates with references are always preferred by our clients. Now is the most important time to stand out from the crowd. We suggest that you ensure you have updated your LinkedIn profile and that you start collecting your references early.

Keywords: Syndicatebleu, New England , Data Engineer, Engineering , Bristol, Northeast