Senior Data Engineer(Python, AWS)

2 days ago

Gurgaon, Haryana, India S&P Global Market Intelligence Full time
Job Description

Responsibilities

- Design, develop, and maintain scalable ETL/ELT pipelines.
- Optimize and automate data ingestion, transformation, and storage processes.
- Work with structured and unstructured data sources, ensuring data quality and consistency.
- Develop and maintain data models, warehouses, and databases.
- Collaborate with cross-functional teams to support data-driven decision-making.
- Ensure data security, privacy, and compliance with industry standards.
- Troubleshoot and resolve data-related issues in a timely manner.
- Monitor and improve system performance, reliability, and scalability.
- Stay up-to-date with emerging data technologies and recommend improvements to our data architecture and engineering practices.

What you will need:

- Strong programming skills using python.
- 5+ years of experience in data engineering, ETL development, or a related role.
- Proficiency in SQL and experience with relational (PostgreSQL, MySQL, etc.) and NoSQL (DynamoDB, MongoDB etc) databases.
- Proficiency building data pipelines in AWS using services like Glue, Batch, Step Functions, Lambda, SQS, SNS, DynamoDb etc..
- Strong understanding of data modeling, data warehousing, and data governance principles.
- Should be capable of mentoring junior data engineers and assisting them with technical challenges.
- Familiarity with orchestration tools like Apache Airflow.
- Familiarity with containerization and orchestration (Docker, Kubernetes).
- Experience with version control systems (Git) and CI/CD pipelines.
- Excellent problem-solving skills and ability to work in a fast-paced environment.
- Excellent communication skills.
- Should be able to convert business queries into technical documentation.
- Hands-on experience with snowflake is a plus.
- Experience with big data technologies (Hadoop, Spark, Kafka, etc.) is a plus.
- Experience in GCP is a plus.

Education and Experience

- Bachelors degree in Computer Science, Information Systems, Information Technology, or a similar major or Certified Development Program
- 5+ years of experience building data pipelines using python & AWS.

  • Senior Data Engineer

    6 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job OverviewA senior data engineer is needed to lead the development of our ETL processes using AWS, Python, Spark, and Databricks. The ideal candidate will have expertise in designing and implementing scalable data pipelines and collaborating with cross-functional teams.

  • Senior Software Engineer

    3 days ago

    Gurgaon, Haryana, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 18,00,000

    Job Title : Senior Software Engineer - Python/React/AWSLocation : Gurgaon (Onsite)Experience : 4+ yearsAbout the Role : We are seeking a seasoned Senior Software Engineer to join our team and drive the development of scalable applications using Python, React, and AWS Cloud. The ideal candidate will have a proven track record of designing, developing, and...

  • AWS Data Engineering Manager

    2 days ago

    Gurgaon, Haryana, India Recro Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    We are seeking an experienced Senior AWS Data Engineer or Data Engineering Manager with 12 years of hands-on expertise in designing, building, and managing scalable data platforms on AWS. The ideal candidate will have deep knowledge of AWS services including Redshift, Glue, Lambda, Athena, S3, and strong proficiency in SQL and PySpark. Key...

  • Manager -Data Engineer (AWS, Python, Spark, Databricks for ETL - Agentic AI

    4 days ago

    Gurgaon, Haryana, India Genpact Full time

    Job DescriptionInviting applications for the role of Manager -Data Engineer (AWS, Python, Spark, Databricks for ETL - Agentic AIIn this role, you%27ll be part of Genpact%27s transformation under GenpactNext, as we lead the shift to Agentic AI Solutions-domain-specific, autonomous systems that redefine how we deliver value to clients. You%27ll help drive the...

  • AWS Data Engineering Professional

    4 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000

    Data Engineer Consultant Job OpportunityJob OverviewWe are seeking a highly skilled Data Engineer Consultant to join our team. The ideal candidate will have experience in designing, implementing data pipelines, building data applications, and migrating data on AWS.Key Responsibilities:Design and develop scalable backend services using Node.js, integrating...

  • Consultant -Data Engineer ( AWS, Python, Spark, Databricks for ETL -Agentic AI

    6 days ago

    Gurgaon, Haryana, India Genpact Full time

    Job DescriptionInviting applications for the role of Consultant -Data Engineer ( AWS, Python, Spark, Databricks for ETL -Agentic AIIn this role, you%27ll be part of Genpact%27s transformation under GenpactNext, as we lead the shift to Agentic AI Solutions-domain-specific, autonomous systems that redefine how we deliver value to clients. You%27ll help drive...

  • Python Data Engineer

    3 days ago

    Gurgaon, Haryana, India beBeeDataScientist Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Job Description:We are seeking a highly skilled Python Developer to join our team. As a Senior Associate - Python Developer, your primary responsibilities will include working closely with external vendors and internal technical teams to ingest, evaluate, and transform raw data into valuable data assets.Data Ingestion & Asset Creation:Design and implement...

  • Senior Python Engineer

    1 day ago

    Gurgaon, Haryana, India V2 Retail Full time

    Job Description- Design and implement reliable, well-tested Python services and APIs (REST/GraphQL).- Lead system design for new features, covering data models, storage, caching, and scalability.- Write clean, maintainable code with type hints, docstrings, and strong unit/integration tests.- Build and optimize database layers (PostgreSQL/MySQL) with ORMs...

  • Senior Data Engineer

    3 days ago

    Gurgaon, Haryana, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Job Opportunity: Senior Python Data EngineerWe are seeking a highly skilled Senior Python Data Engineer to join our team. The ideal candidate will have experience in designing, developing, and maintaining performant SQL scripts, stored procedures, and queries in Snowflake.Key Responsibilities:Collaborate with business analysts and domain experts to translate...

  • Python Data Architect

    3 days ago

    Gurgaon, Haryana, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000

    About This Role:We are seeking a seasoned professional with extensive experience in Python Data Engineering and programming management to lead our data initiatives. The ideal candidate will possess deep expertise in Python programming, a proven track record of building and deploying complex data-driven solutions, and a passion for driving business growth.The...