Data Engineer

3 weeks ago

Gurgaon, Haryana, India Staffice Global Private Limited Full time
Job Description

This role is for a Data Engineer with extensive experience in data engineering, data warehousing, and big data processing. The ideal candidate will have strong expertise in Python, PySpark, and AWS data services to design, develop, and maintain robust data pipelines.

Key Responsibilities

- Design and implement end-to-end data engineering solutions using a combination of Python and AWS data services like Glue, Lambda, and EMR.
- Develop and maintain scalable ETL (Extract, Transform, Load) pipelines.
- Utilize PySpark for efficient big data processing and transformation.
- Work with Kafka for real-time data ingestion and stream processing.
- Optimize and fine-tune data pipelines for performance, scalability, and cost-efficiency on the AWS platform.
- Implement data security measures and contribute to data governance practices.
- Collaborate with cross-functional teams to understand data requirements and translate them into scalable data architectures.
- Troubleshoot and resolve complex data workflow issues.

Skills

Required Skills:

- Strong expertise in Python and SQL for data manipulation and pipeline development.
- Hands-on experience with PySpark for big data processing.
- Deep understanding of AWS data services such as Redshift, Glue, S3, Lambda, Kinesis, Athena, and DynamoDB.
- Experience with Kafka for real-time data ingestion.
- Strong experience in data modeling, schema design, and ETL best practices.
- Excellent problem-solving skills with the ability to debug complex data workflows.

Preferred Skills:

- Familiarity with infrastructure as code (IaC) tools like Terraform or CloudFormation.

Qualifications

- A minimum of 5 years of experience in data engineering, data warehousing, and big data processing.

  • Data Engineer

    14 hours ago

    Gurgaon, Haryana, India RBS Full time US$ 9,00,000 - US$ 12,00,000 per year

    Join us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India NS Global Corporation Full time

    Job Role : Data Engineer - Senior LevelJob Locations : Gurugram, Haryana, IndiaRequired Experience : 7 - 10 YearsClient Budget : 2.0 LPM + GSTOur budget : 1.7 lpmSkills : data warehouse, Architectural Patterns, Modern data engineering tools and framework, AWS, SQL, File FormatsResponsibilities : - Design, develop and own robust data pipelines, ensuring...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Policybazaar Full time

    Job DescriptionAs a data engineer -YOU GET TO WORK ON- Data modeling for OLAP, warehousing and building ETL pipelines on cloud- AWS technologies like EMR, Lambda, S3, SQS, EC2, Glue, etc- Using Airflow for orchestrationBASIC QUALIFICATIONS- 1-3 years of data engineering experience- Experience with SQL and NoSQL databases- Practical Knowledge of Linux or Unix...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Boston Consulting Group Full time

    *Locations*: Bengaluru | GurgaonWho We AreBoston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling...

  • Data engineer

    19 hours ago

    Gurgaon, Haryana, India Boston Consulting Group Full time

    *Locations*: Bengaluru | GurgaonWho We AreBoston Consulting Group partners with leaders in business and society to tackle their most important challenges and capture their greatest opportunities. BCG was the pioneer in business strategy when it was founded in 1963. Today, we help clients with total transformation-inspiring complex change, enabling...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India ORBION INFOTECH Full time

    Job Description :Key Responsibilities :- Data Architecture & Strategy : Design and build scalable and reliable data architectures, data warehouses, and data lakes.- ETL/ELT Pipeline Development : Architect, build, and optimize complex ETL/ELT processes to ingest, transform, and load data from diverse sources.- Cloud Platform Expertise : Leverage extensive...

  • Senior Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India IT Firm Full time

    We are seeking an experienced and highly motivated Senior Data Engineer to join our dynamic team. The ideal candidate will play a critical role in designing, developing, and maintaining high-performance data infrastructure and pipelines. As a Senior Data Engineer, you will be responsible for ensuring the scalability, performance, and reliability of data...

  • Data Engineer

    2 days ago

    Gurgaon, Haryana, India Talent Worx Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Position: Data Engineer (Sr. Analyst)JOB SUMMARYThe Data Engineer will have responsibility to use various methods to transform raw data into usefuldata systems and should have strong analytical skills and the ability to combine data from differentsources. The person must have familiarity with several programming languages and knowledge oflearning machine...

  • Data Engineer

    4 weeks ago

    Gurgaon, Haryana, India Sureminds Solutions Full time

    Job Description : Data Engineer Python + AWS + AIExp Level : 5 to 8 yearsLocation : Gurgaon & RemoteInterview Process : Assessment OR 1st Technical interview , 2 - Client interview , 1 HR Round.Role Overview : Lead design and delivery of LLM-powered, agentic AI solutions with robust RAG pipelines and prompt-engineering best practices.Key Responsibilities :-...

  • Data Engineer, VP

    2 days ago

    Gurgaon, Haryana, India RBS Full time US$ 1,20,000 - US$ 2,00,000 per year

    Join us as a Data EngineerYou'll be the voice of our customers, using data to tell their stories and put them at the heart of all decision-makingWe'll look to you to drive the build of effortless, digital first customer experiencesIf you're ready for a new challenge and want to make a far-reaching impact through your work, this could be the opportunity...