AWS Data Engineer

7 days ago


bangalore, India Synechron Full time
Job Title: Senior Data Engineer - AWS, Python, PySpark, Hive, SQL
Location: Pune/Bangalore
Experience Required: 7+ years
Role Summary: As a Senior Data Engineer, you will lead the design and implementation of scalable, high-performance data solutions on AWS. You will leverage your deep expertise in Python, PySpark, Hive, and SQL to build and optimize data pipelines, support data modeling, and contribute to the architecture that supports big data processing and analytics.
Key Responsibilities:
Design and develop robust, scalable data pipelines using AWS services, Python, PySpark, Hive, and SQL.
Optimize data processing and storage for performance and cost.
Implement data security and compliance best practices in collaboration with the IT security team.
Lead the migration of legacy data warehouses and data marts to AWS cloud-based data lake and data warehouse solutions.
Work closely with data scientists and analysts to support their data needs and assist in building complex queries and data analysis pipelines.
Create and maintain comprehensive documentation of data pipelines, architectures, and workflows.
Continuously evaluate new technologies and AWS services to enhance data capabilities and performance.
Collaborate with cross-functional teams to understand their data needs and translate them into technical requirements.
Participate in code reviews and ensure that all solutions are aligned to pre-defined architectural specifications.
Provide mentoring and guidance to junior data engineers and team members.
Day-to-Day Activities:
Engage in daily stand-up meetings to discuss progress, obstacles, and timelines.
Design, code, test, and deploy new data pipelines and enhancements to existing pipelines.
Perform data modeling and ETL development as required for ongoing projects.
Monitor AWS resources and optimize the cost and performance of data applications.
Conduct data analysis and troubleshooting on complex data processing issues.
Collaborate with BI and analytics teams to assist in data-related technical issues and support their data infrastructure needs.
Lead performance tuning activities on SQL queries and PySpark jobs.
Ensure the integrity and availability of data by implementing proper backup and disaster recovery strategies.
Remain up-to-date with industry trends and advancements in big data and cloud computing.
Qualifications:
Bachelor's or Master’s degree in Computer Science, Engineering, or a related technical field.
7+ years of experience in a data engineering role with a strong focus on AWS, Python, PySpark, Hive, and SQL.
Proven experience in designing and delivering large-scale data warehousing and data processing solutions.
Strong understanding of AWS services such as S3, EC2, EMR, RDS, Redshift, Glue, Lambda, and Athena.
Deep knowledge of big data technologies and ETL tools.
Excellent problem-solving, analytical, and communication skills.
Ability to work independently as well as part of a team in a fast-paced environment.
Preferred Qualifications:
AWS certifications related to data engineering or architecture.
Experience with additional big data technologies like Kafka, Spark Streaming, or Hadoop.
Familiarity with machine learning concepts and tools.
  • AWS Data Engineer

    7 days ago


    bangalore, India Genpact Full time

    Genpact (NYSE: G) is a global professional services and solutions firm delivering outcomes that shape the future. Our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients. Powered by our purpose – the relentless pursuit of a world that works better for people – we...

  • AWS Data Engineer

    7 days ago


    bangalore, India NAM Info Inc Full time

    Job Title: AWS Data Engineer with PySparkLocation: Bangalore, ChennaiFulltimeJob Description:Preferred Skills and Qualifications:Proficient in AWS Cloud services and infrastructure.Strong experience with Databricks and PySpark.Extensive knowledge of data gathering ingestion, manipulation, orchestration, and optimization.Proven track record of leading...

  • AWS Data Engineer

    7 days ago


    bangalore, India Deloitte Full time

    What impact will you make?Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential.Deloitte is where you’ll find unrivaled...

  • AWS Data Engineer

    3 days ago


    Bangalore, India Deloitte Full time

    What impact will you make? Every day, your work will make an impact that matters, while you thrive in a dynamic culture of inclusion, collaboration and high performance. As the undisputed leader in professional services, Deloitte is where you’ll find unrivaled opportunities to succeed and realize your full potential. Deloitte is where you’ll find...


  • bangalore, India TekWissen India Full time

    Role: AWS Redshift Data EngineerLocation: Bangalore, IndiaWork Mode: WFONotice Period: Immediate joiner only.Mandatory Skills: AWS Redshift, ETL processes and data warehousing.Summary:As an Application Developer, you will be responsible for designing, building, and configuring applications to meet business process and application requirements using AWS...

  • AWS Data Engineer

    7 days ago


    Bangalore Urban, India NAM Info Inc Full time

    Job Title: AWS Data Engineer with PySpark Location: Bangalore, Chennai Fulltime Job Description: Preferred Skills and Qualifications: Proficient in AWS Cloud services and infrastructure. Strong experience with Databricks and PySpark. Extensive knowledge of data gathering ingestion, manipulation, orchestration, and optimization. Proven track record of...

  • AI Data Engineer

    3 months ago


    Bangalore, India ApicalGo Consultancy Full time

    Primary Purpose : Building and maintaining the company's data infrastructure on the AWS cloud platform, with a specific focus on supporting AI model training, development, and deployment. This includes designing, developing, and implementing data pipelines, ensuring the secure and efficient flow of data for our AI models.Responsibilities : Data for AI...


  • Bangalore City, India Deloitte Full time

    We are looking for Candidates who are having experience as Python AWS Data Engineer Experience Required: 3 10 YearsLocation: Delhi ,Bangalore, Hyderabad Responsibilities:Good Hands on Experience in to Python, AWS, Libraries, Athena, Glue, EmR, EC2

  • Data Engineer

    4 weeks ago


    Bangalore, India NTT DATA Services Full time

    Req ID: 287747  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Mandatory Skills...

  • Data Engineer

    1 month ago


    Bangalore, India NTT DATA Services Full time

    Req ID: 287747  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Mandatory Skills...

  • Sr data engineer

    1 month ago


    Bangalore, India NTT DATA Services Full time

    Req ID: 286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data...


  • Bengaluru/ Bangalore, India timesjobs Full time

    IntroductionIn this role, youll work in one of our IBM Consulting Client Innovation Centers (Delivery Centers), where we deliver deep technical and industry expertise to a wide range of public and private sector clients around the world. Our delivery centers offer our clients locally based skills and technical expertise to drive innovation and adoption of...

  • Senior Data Engineer

    3 months ago


    bangalore, India Zyoin group Full time

    Key Accountabilities and Decision Ownership: - Data Pipeline Development: Develop and maintain robust data pipelines to ingest, transform, and deliver data from various sources to downstream systems, data lakes, and data warehouses. - Data Transformation: Perform data cleansing, enrichment, and transformation using Python, Spark, and SQL to ensure data...

  • Data Platform Engineer

    3 months ago


    Bangalore, India Reed & Willow Talent Advisors Full time

    Job Title : Lead Data Platform Engineer& Senior Data Platform : Bangalore, India Work arrangements : : 10-20 Years No of Openings : 03 Tech Skills : Terraform, Airflow, AWS, Big Query & : B.Tech/M.Tech/ IT or Computer Science from a reputed college or Premier college Below is a snapshot of the company Details Company Type : Product Based...

  • Data Engineer

    3 days ago


    Bangalore, India Kratos Gamer Network Full time

    About KGeN: Kratos Studios is dedicated to integrating micro-gaming communities into Web3 through the development of the powerful P.O.G. (Proof of Gamer) Engine and The Kratos Gaming Network (KGeN). The P.O.G Engine aims to facilitate seamless interactions between gamers and game developers worldwide via the multi-chain gaming data network - KGEN.. ...

  • AWS Architect

    7 days ago


    bangalore, India HCLTech Full time

    About HCLTechHCL Technologies is a next-generation global technology company that helps enterprises reimagine their businesses for the digital age. Our technology products and services are built on four decades of innovation, with a world-renowned management philosophy, a strong culture of invention and risk-taking, and a relentless focus on customer...

  • Data Engineer

    3 months ago


    Bangalore, India SS Consultancy Services Full time

    The Data Engineer will report to the Data Engineering & BI Lead of the company and will be responsible to develop and implement a future-state data analytics platform for both the back-end data processing and the front-end data visualization component for the Finance Data Delivery teams. The will be a hands on role to build ingestion pipelines and the data...

  • Data Engineer

    7 days ago


    bangalore, India EXL Full time

    Data Engineer JD:Job OverviewWe are looking for a Data Engineer with 4-5 years of experience in the data engineering space, preferably within the banking or financial services sector. The ideal candidate will have a strong background in data architecture, ETL processes, and data pipeline development. They will play a crucial role in designing, implementing,...

  • Data Engineer

    3 months ago


    bangalore, India Sun Life Full time

    Key ResponsibilitiesThis is a position for AWS data engineer typically works on development, implementing, and maintaining data solutions on the Amazon Web Services (AWS) platform.Working with the Subject Matter Experts and Business Analysts to grasp the best knowledge of existing/ new SLF investment product architecture and implement new features in the...

  • Data Engineer

    3 days ago


    Bangalore, India ACL Digital Full time

    Note:- Only Immediate joiner's preferred.. Location:- Bangalore (Hybrid Model) Data Engineer- 4-6 years of hands on application development experience in one or more programming languages like Python, Pyspark etc. 4-6 years of hands on experience in development and deployment of cloud native solutions leveraging AWS Services: Compute(EC2, Lambda),...