AWS Data Architect with Glue & Snowflake Exp

Company: Purple Drive Technologies LLC
Location: Danbury
Posted on: February 16, 2020

Job Description:

Hi, We have the following position for one of our customer. Kindly let me know whether you would be interested. Role: AWS Data Architect with Glue & Snowflake Exp. 2 Positions Location: Danbury, CT JD: Your Role Data Architect A day in the Life of Data architect at Client. You will partner closely with the clients to deliver state of the art outcomes by engineering solutions. You will continue to expand your expertise in Data Science, Big Data, Analytics and Visualization tools techniques daily to enable incremental innovation in ongoing projects At all times, you will clearly articulate and communicate with a diverse set of internal and external customers with varying degrees of technical proficiency and deliver critical business and process-related information to mitigate any risks or failures You will persistently look for opportunities to address customer needs by being a thought partner in every moment of engagement For you to be successful, You must Build partnerships within and outside the team regardless of formal authority Dismantle personal knowledge and empower others by mentoring and fostering an environment of growth Create value by anticipating and meeting needs of internal and external customers and delivering high quality results and be accountable for outcomes Open and flexible to accommodate and implement new ideas, understand business complexities, nurture innovation and challenge the status quo persistently Grasp data that is available, pay attention to details and strive to be subject matter expert in chosen area of specialty through continuous learning and improvement You ll bring this to the table Experience in driving solution architecture, planning infra, building large scale and secure data analytics applications Ability to create technical architecture for modern data platforms with considerations such as business & technology landscape, functional and nonfunctional requirements, right tool sets, etc., End to end implementation experience in data analytics solutions (data ingestion, processing, provisioning and visualization) for largescale and complex environments Experience working with data pipelines, distributed computing platforms, cloud platforms, visualization tools, supporting BI and data science consumers, exposure to supporting AIML use cases Hands on experience developing enterprise solutions using designing and building frameworks, enterprise patterns, database design and development Responsibilities: Development experience using (Must Have) End to end implementation of Cloud data engineering solution AWS (EC2, S3, EMR, Spectrum, Dynamo DB, RDS, Redshift, Glue, Kinesis) ETL Process implementation using AWS Glue Batch solution and distributed computing using ETLELT (Spark, SQLSpark, Data frame, AWS Glue Stitch) DWBI (Oracle, Teradata), Data modeling, performance tuning, memory optimization DB partitioning Frameworks, reusable components, accelerators, CICD automation Languages (Python, Scala) Proficiency in data modelling, for both structured and unstructured data, for various layers of storage Ability to collaborate closely with business analysts, architects and client stake holders to create technical specifications Ensure quality of code components delivered by employing unit testing and test automation techniques including CI in DevOps environments. Ability to profile data, assess data quality in the context of business rules, and incorporate validation and certification mechanism to ensure data quality Ability to review technical deliverables, mentor and drive technical teams to deliver quality technical deliverables. Understand system Architecture and provide component level design specifications, both high level and low level design Good to have: Knowledge on Snowflake ETL integration, End to end implementation of Big data solution on Cloudera/Hortonworks/MapR ecosystem, Realtime solution using Spark streaming, Kafka Apache pulsarKinesis Distributed compute solution (Spark/ Storm/ Hive/ Impala) Distributed storage and NoSQL storage (Cassandra, Mongo DB, Datastax) - provided by Dice

Keywords: Purple Drive Technologies LLC, New England , AWS Data Architect with Glue & Snowflake Exp, Other , Danbury, Northeast