Big Data Engineer

6 hours ago

Delhi NCR, India Qcentrio Full time US$ 90,000 - US$ 1,20,000 per year

We are seeking an experienced and driven Data Engineer with 5+ years of hands-on experience in building scalable data infrastructure and systems. You will play a key role in designing and developing robust, high-performance ETL pipelines and managing large-scale datasets to support critical business functions. This role requires deep technical expertise, strong problem-solving skills, and the ability to thrive in a fast-paced, evolving environment.

Key Responsibilities :

  • Design, develop, and maintain scalable and reliable ETL/ELT pipelines for processing large volumes of data (terabytes and beyond).

  • Model and structure data for performance, scalability, and usability.

  • Work with cloud infrastructure (preferably Azure) to build and optimize data workflows.

  • Leverage distributed computing frameworks like Apache Spark and Hadoop for large-scale data processing.

  • Build and manage data lake/lakehouse architectures in alignment with best practices.

  • Optimize ETL performance and manage cost-effective data operations.

  • Collaborate closely with cross-functional teams including data science, analytics, and software engineering.

  • Ensure data quality, integrity, and security across all stages of the data lifecycle.

Required Skills & Qualifications :

  • 7 to 10 years of relevant experience in bigdata engineering.

  • Advanced proficiency in Python,

  • Strong skills in SQL for complex data manipulation and analysis.

  • Hands-on experience with Apache Spark, Hadoop, or similar distributed systems.

  • Proven track record of handling large-scale datasets (TBs) in production environments.

  • Cloud development experience with Azure (preferred), AWS, or GCP.

  • Solid understanding of data lake and data lakehouse architectures.

  • Expertise in ETL performance tuning and cost optimization techniques.

  • Knowledge of data structures, algorithms, and modern software engineering practices.

Soft Skills :

  • Strong communication skills with the ability to explain complex technical concepts clearly and concisely.

  • Self-starter who learns quickly and takes ownership.

  • High attention to detail with a strong sense of data quality and reliability.

  • Comfortable working in an agile, fast-changing environment with incomplete requirements.

Preferred Qualifications :

  • Experience with tools like Apache Airflow, Azure Data Factory, or similar.

  • Familiarity with CI/CD and DevOps in the context of data engineering.

  • Knowledge of data governance, cataloging, and access control principles.

Skills : Python,Sql,Aws,Azure, Hadoop

  • Big Data Engineer

    4 weeks ago

    Thane, Chennai, Delhi NCR, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will have extensive experience in designing and implementing big data solutions that drive data-driven decision-making. The candidate will work closely with cross-functional teams to develop robust data processing...

  • Big Data Engineer

    6 hours ago

    Delhi, NCR, India Qcentrio Full time US$ 1,50,000 - US$ 2,00,000 per year

    Work Location : Pan India Experience : 6+ Years Notice Period : Immediate - 30 days Mandatory Skills : Big Data, Python, SQL, Spark/Pyspark, AWS Cloud JD and required Skills & Responsibilities : Actively participate in all phases of the software development lifecycle, including requirements gathering, functional and technical design, development,...

  • Big Data Engineer

    16 hours ago

    Delhi, Delhi, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Big Data EngineerWe are seeking a skilled data expert to fill this challenging role. The ideal candidate will have strong expertise in modern data engineering technologies and the ability to work in a fast-paced environment.Develop, optimize, and manage large-scale data pipelines using Databricks, PySpark, DBT, and cloud storage services.Work in...

  • Big Data Engineer

    1 day ago

    Delhi, Delhi, India Eqaim Technology & Services Full time

    Job Description : Big Data Engineer We are looking for a highly skilled Big Data Engineer to join our team. In this role, you will contribute to building and optimizing scalable data solutions that empower businesses to optimize promotional activities and maximize return on investment. You will work on data collection, validation, and analysis, while...

  • Big Data Engineer

    3 weeks ago

    Delhi, Mumbai City, Noida, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a skilled Big Data Engineer to join our dynamic team in India. The ideal candidate will be responsible for designing and implementing robust data pipelines, managing large datasets, and collaborating with various stakeholders to ensure optimal data flow and accessibility.Responsibilities- Design, develop, and maintain...

  • Big Data Engineer

    5 days ago

    Delhi, Mumbai, Kolkata, India beBeeDataEngineer Full time US$ 90,000 - US$ 1,20,000

    Job Title: Data Engineer for Big Data ProcessingWe are seeking an experienced data engineer to drive the development of robust data processing and transformation solutions within our data platform. You will be responsible for designing, implementing, and maintaining PySpark-based applications to handle complex data processing tasks, ensure data quality, and...

  • Unlock the Power of Big Data Engineering

    1 week ago

    Bengaluru / Bangalore, Delhi NCR, Kolkata, India beBeeData Full time

    Job Role: Big Data EngineerProject Overview:The ideal candidate will be responsible for designing, building, and maintaining applications using the latest big data technologies. The typical day involves working closely with cross-functional teams to analyze business requirements and develop solutions that meet those needs.Key Responsibilities:Design,...

  • Big Data Engineer

    5 hours ago

    Delhi, Delhi, India prudential Manpower Pvt Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Education and Experience :Bachelor's degree in computer science, or similar technical field Minimum 5 years of experience in Big Data Engineering/Data Analysis5 Days Work From Office :Preferred Skills and Qualifications : Proficiency in Python, SQL and Apache SparkAWS services such as EMR, Glue (server less architecture), S3, Athena, IAM, Lambda and Cloud...

  • Senior Big Data Engineer

    2 days ago

    Kolkata, Delhi, Mumbai, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 30,00,000

    We are currently seeking a highly skilled Data Engineer to lead our data platform development team and drive the creation of robust, scalable data processing solutions.Job Description:Data Engineering Development:Design, develop, and test complex data processing applications using Apache Spark to handle large-scale datasets from various sources, including...

  • Big Data Solutions Specialist

    18 hours ago

    Delhi, Delhi, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Big Data Engineer OpportunityWe are seeking an experienced Big Data Engineer to join our team. As a key member of our data engineering team, you will play a crucial role in designing and developing scalable data pipelines, processing systems, and workflows.About the RoleThe ideal candidate will have hands-on experience with big data technologies such as...