AWS Data Engineer

Fractal


Date: 3 weeks ago
City: Bengaluru, Karnataka
Contract type: Full time
It's fun to work in a company where people truly BELIEVE in what they are doing!

We're committed to bringing passion and customer focus to the business.

Job Profile - Senior Engineer AWS cloud

Exp - 6-10 years

Job Location – Bangalore

Responsibilities

As a Data Engineer, you will be responsible implementing complex data pipelines and analytics

solutions to support key decision-making business processes in our client’s domain. You will

gain exposure to a project that is leveraging cutting edge AWS technology that applies Big Data

and Machine Learning to solve new and emerging problems for our clients. You will gain a

added advantage of working very closely with AWS Professional Services teams directly

executing within AWS Services and Technologies to solve complex and challenging business

problems for Enterprises.

Key Responsibilities Include

  • Work closely with Product Owners and AWS Professional Service Architects to understand


requirements, formulate solutions, and implement them.

  • Implement scalable data transformation pipelines as per design
  • Implement Data model and Data Architecture as per laid out design.
  • Evaluate new capabilities of AWS analytics services, develop prototypes, and assist in drawing


POVs , participate in design discussions

Requirements

  • Minimum 3 years’ experience implementing transformation and loading of data from a


wide variety of traditional and non-traditional sources such as structured, unstructured,

and semi structured using SQL, NoSQL and data pipelines for real-time, streaming,

batch and on-demand workloads

  • At least 2 years implementing solutions using AWS services such as Lambda, AWS


Athena and Glue AWS S3, Redshift, Kinesis, Lambda, Apache Spark,

  • Experience working with data warehousing data lakes or Lakehouse concepts on AWS
  • Experience implementing batch processing using AWS Glue/Lake formation, & Data


Pipeline

  • Experience in EMR/MSK
  • Experience or Exposure to AWS Dynamo DB will be a plus
  • Develop object-oriented code using Python, besides PySpark, SQL and one other


languages (Java or Scala would be preferred)

  • Experience on Streaming technologies both OnPrem/Cloud such as consuming and


producing from Kafka, Kinesis

  • Experience building pipelines and orchestration of workflows in an enterprise


environment using Apache Airflow/Control M

  • Experience implementing Redshift on AWS or any one of Databricks on AWS, or Snowflake on AWS
  • Good understanding of Dimensional Data Modelling will be a plus.
  • Ability to multi-task and prioritize deadlines as needed to deliver results
  • Ability to work independently or as part of a team
  • Excellent verbal and written communication skills with great attention to detail and accuracy
  • Experience working in an Agile/Scrum environment


If you like wild growth and working with happy, enthusiastic over-achievers, you'll enjoy your career with us!

Not the right fit? Let us know you're interested in a future opportunity by clicking Introduce Yourself in the top-right corner of the page or create an account to set up email alerts as new job postings become available that meet your interest!

How to apply

To apply for this job you need to authorize on our website. If you don't have an account yet, please register.

Post a resume

Similar jobs

Shift Incharge-Jr Engineer Production Press line

Sansera Engineering Limited, Bengaluru, Karnataka
2 hours ago
Job Title: Shift Incharge - Jr Engineer Job Description: The Shift Incharge - Jr Engineer will be responsible for overseeing the operations of the production shift, ensuring that all activities run smoothly and efficiently. The individual will supervise a team of operators and ensure that all production targets are met while adhering to safety and quality standards. The role involves...

IT Operations Administrator

Emmes Group, Bengaluru, Karnataka
2 days ago
JOB_DESCRIPTION.SHARE.HTMLCAROUSEL_PARAGRAPHJOB_DESCRIPTION.SHARE.HTMLBengaluru, IndiaInformation TechnologyNoRegular Full-Time2676Emmes Globalmail_outlineGet future jobs matching this searchorOverviewJob DescriptionEmmes Group: Building a better future for us all.Emmes Group is transforming the future of clinical research, bringing the promise of new medical discovery closer within reach for patients. Emmes Group was founded as Emmes more than 47 years ago, becoming one of the primary clinical research providers to the...

Senior Software Engineer

Microsoft, Bengaluru, Karnataka
2 days ago
OverviewDo you want to join a world-class engineering team in India and work on hard technical challenges? Are you interested to work in a globally distributed team with an exceptional record of innovation and execution that has made us one of the largest businesses within Microsoft? If yes, keep reading…Azure SQL Database is a fast-growing platform as a service that...