Senior Data Engineer

Team: Team is Client delivery platform and Cumulus - lots of data exchanges: AWS platform using Redshift as data warehouse - Dynamo of meta-data. They are working on evolving code for digital SAT products and need dynamic Senior Data engineer who will also design, build and write test automation.

Profile: Senior Data Engineer with SME in data analytics end AI work within our tech stack; 5+ years of experience.

Summary Data Engineer must be a skilled engineer with an unwavering passion for excellence in Software Engineering and drive to transform that passion into consistent excellence in product development. The candidate must be customer-obsessed, have strong analytical and communication skills, enjoy working with native AWS services, and thrive on solving challenging business problems. The candidate will partner with Product Owners/Architects, Developers, and other Software Engineers to help design, define, implement functional features, system level validation and verify features of product development. Qualified candidates will show an aptitude learning and implementation of advanced software engineering practices in Data Analytics, AWS, Microservices environment to solve complex problems with a mission to release high quality software that is resilient and optimally performing. Candidates will be engaged in both data and analytics reports development and quality engineering, testing and automation as a data engineer.

Responsibilities

Collaborate with and across Agile teams to design, develop, test, implement, and support technical solutions in full-stack development tools and technologies

Builds, tests, deploys and maintains production code for complex transactional applications using event driven microservices, node.js, Python languages. Incorporates Cloud technologies on new application development to include micro-services, SQL and AWS services such as lambda, S3, SQS, SNS, DynamoDB, Quicksight, AWS Redshift, Opensearch.

Perform unit tests and conduct reviews with other team members to make sure your code is rigorously designed, elegantly coded, and effectively tuned for performance

Required Skills

• Expert in writing and optimizing complex SQL queries for data extraction, transformation, and reporting (e.g., SELECT, JOIN, GROUP BY, HAVING, WINDOW functions).
• Expert integrating Redshift Serverless with AWS services such as S3, Glue, Lambda, Athena, and Kinesis BI tools like Tableau, Quicksight, or Looker for real-time analytics and dashboards
• Expert in building serverless ETL pipelines with Lambda to automate data ingestion and transformation into Redshift.
• Experience in integrating Redshift Serverless with
• Experience of NodeJS and Python
• Working knowledge of any AI technologies
• Experience in working with AWS services, deploying applications to AWS
• Exposure to DevOps tools and automation
• Effective communication skills are a must along with a strong customer service orientation, and the ability to clearly discern client needs.