NewEnglandRecruiter Since 2001
the smart solution for New England jobs

Big Data Engineer

Company: Mindlance
Location: Bloomfield
Posted on: January 16, 2022

Job Description:

Job DescriptionBig Data Engineer
Position Description
Join this exciting new initiative as a Big Data engineer with skills in Tableau, Big Data, SQL! With your expertise with Data engineering you will work with a high-performing team to design and develop solutions to build Big Data Solutions.
Qualified candidates for this position must have deep understanding of Data Warehousing.
You will work with a high-performing team to develop solutions for a major client. You will support and interact with the client daily in an Agile way of working. You will have the opportunity to show/grow with technology in a customer-facing role. You should be able to work independently under limited supervision and apply your knowledge. You should have sufficient knowledge and maturity to effectively deal with technical issues and help to support the broader team. Your success will be directly related to ***s and our clients success.
Your future duties and responsibilities
Data Ingestion using Kafka, CDC or similar technologies.
Implement and support streaming technologies such as Kafka, K-SQL and Spark.
Implement and support big data tools and frameworks such as HDFS, Hive, and Hbase or Cassandra.
ETL Design and Development in the big data platform in Hadoop using technologies such as Scala, Spark, Python, Oozie, and more to support a variety of requirements and applications.
Warehouse Design and Development Set the standards for warehouse and schema design in massively parallel processing engines such as Hadoop and Columnar Databases while collaborating with analysts and data scientist in the creation of efficient data models.
Implement a CICD DevOps strategy
Implement end to end Data Lake solution in on premise as well as on a cloud environment preferably Azure and AWS.
Deliver a Client/AI framework to support user Analysts and data scientists to support advance analytics.
Required qualifications to be successful in this role
7+ years of work experience with ETL, and business intelligence big data architectures.
5+ years of experience with the Hadoop ecosystem (Map Reduce, Hive, Oozie, Yarn, HBase, etc.) and big data ecosystems (Kafka, Cassandra, etc.).
3+ years of hands-on Spark/Scala/Python development experience.
Experience developing and managing data warehouses on a terabyte or petabyte scale.
Experience with core competencies in Data Structures, Rest/SOAP APIs, JSON, etc.
Strong experience in massively parallel processing & columnar databases.
Expert in writing SQL PLSQL or NoSQL
Deep understanding of advanced data warehousing concepts and track record of applying these concepts on the job.
Experience with common software engineering tools (e.g., Git, JIRA, Confluence, or similar)
Ability to manage numerous requests concurrently and strategically, prioritizing when necessary.
Good communication and presentation skills.
Dynamic team player.
Knowledge and experience in Business Object (BO) reporting a good to have.
Skill Set/Years of Experience/Proficiency Level
Data Engineering
Big Data
Minimum Education Required: Bachelors Degree
"Mindlance is an Equal Opportunity Employer and does not discriminate in employment on the basis of - Minority/Gender/Disability/Religion/LGBTQI/Age/Veterans.": 21-68878 : Bloomfield, CT:

Keywords: Mindlance, New England , Big Data Engineer, Engineering , Bloomfield, Northeast

Click here to apply!

Didn't find what you're looking for? Search again!

I'm looking for
in category

Log In or Create An Account