Big Data Engineer
Posted on: January 16, 2022
Job DescriptionBig Data Engineer
Join this exciting new initiative as a Big Data engineer with
skills in Tableau, Big Data, SQL! With your expertise with Data
engineering you will work with a high-performing team to design and
develop solutions to build Big Data Solutions.
Qualified candidates for this position must have deep understanding
of Data Warehousing.
You will work with a high-performing team to develop solutions for
a major client. You will support and interact with the client daily
in an Agile way of working. You will have the opportunity to
show/grow with technology in a customer-facing role. You should be
able to work independently under limited supervision and apply your
knowledge. You should have sufficient knowledge and maturity to
effectively deal with technical issues and help to support the
broader team. Your success will be directly related to ***s and our
Your future duties and responsibilities
Data Ingestion using Kafka, CDC or similar technologies.
Implement and support streaming technologies such as Kafka, K-SQL
Implement and support big data tools and frameworks such as HDFS,
Hive, and Hbase or Cassandra.
ETL Design and Development in the big data platform in Hadoop using
technologies such as Scala, Spark, Python, Oozie, and more to
support a variety of requirements and applications.
Warehouse Design and Development Set the standards for warehouse
and schema design in massively parallel processing engines such as
Hadoop and Columnar Databases while collaborating with analysts and
data scientist in the creation of efficient data models.
Implement a CICD DevOps strategy
Implement end to end Data Lake solution in on premise as well as on
a cloud environment preferably Azure and AWS.
Deliver a Client/AI framework to support user Analysts and data
scientists to support advance analytics.
Required qualifications to be successful in this role
7+ years of work experience with ETL, and business intelligence big
5+ years of experience with the Hadoop ecosystem (Map Reduce, Hive,
Oozie, Yarn, HBase, etc.) and big data ecosystems (Kafka,
3+ years of hands-on Spark/Scala/Python development experience.
Experience developing and managing data warehouses on a terabyte or
Experience with core competencies in Data Structures, Rest/SOAP
APIs, JSON, etc.
Strong experience in massively parallel processing & columnar
Expert in writing SQL PLSQL or NoSQL
Deep understanding of advanced data warehousing concepts and track
record of applying these concepts on the job.
Experience with common software engineering tools (e.g., Git, JIRA,
Confluence, or similar)
Ability to manage numerous requests concurrently and strategically,
prioritizing when necessary.
Good communication and presentation skills.
Dynamic team player.
Knowledge and experience in Business Object (BO) reporting a good
Skill Set/Years of Experience/Proficiency Level
DESIRED QUALIFICATIONS/NON-ESSENTIAL SKILLS REQUIRED
Minimum Education Required: Bachelors Degree
"Mindlance is an Equal Opportunity Employer and does not
discriminate in employment on the basis of -
: Bloomfield, CT:
Keywords: Mindlance, New England , Big Data Engineer, Engineering , Bloomfield, Northeast
Didn't find what you're looking for? Search again!