Big Data Engineer

1 day ago

New Delhi, India People Prime Worldwide Full time

About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Position: Data EngineerExperience: 6+ YearsLocation: HyderabadEmployment Type: Full-timeAbout the RoleWe are looking for a highly skilled Data Engineer with 6+ years of experience in designing and building scalable data pipelines, big data processing solutions, and cloud-based data platforms. The ideal candidate will have strong expertise in Big Data technologies, PySpark, Python, AWS, and Snowflake, and will work closely with data architects, analysts, and business stakeholders to deliver efficient, reliable, and high-performance data solutions.Key Responsibilities- Design, develop, and maintain scalable and high-performance ETL/ELT pipelines using PySpark, Python, and SQL. - Build and optimize Big Data processing workflows using Spark, Hive, and other distributed data frameworks. - Develop ETL/ELT frameworks and workflows on AWS cloud using services such as S3, Glue, EMR, Lambda, Step Functions, and Redshift. - Implement and maintain enterprise-grade Snowflake data models, warehouses, data sharing, and performance tuning. - Collaborate with data architects to design end-to-end data architecture, ensuring scalability, security, and reliability. - Perform data ingestion, transformation, quality validation, and metadata management across various structured and unstructured data sources. - Build CI/CD pipelines for data applications using tools like Git, Jenkins, or AWS CodePipeline. - Monitor and optimize data pipelines for cost efficiency, performance, and reliability. - Troubleshoot production issues and implement solutions for long-term stability and scalability. - Ensure compliance with data governance, security best practices, and industry standards.Required Skills & Qualifications- 6+ years of hands-on experience as a Data Engineer or similar role. - Strong proficiency in PySpark, Spark SQL, and Big Data processing frameworks. - Advanced programming skills in Python (data processing, automation, modular coding). - Deep experience with AWS cloud services (S3, EMR, Glue, Lambda, IAM, Redshift, Athena). - Hands-on experience working with Snowflake—data modeling, pipelines, SnowSQL, performance tuning. - Strong SQL skills with experience in optimizing complex queries. - Experience with workflow orchestration tools (Airflow / AWS Step Functions / Apache Oozie). - Knowledge of DevOps practices, CI/CD, and version control (Git). - Experience handling large-scale, distributed data systems in production environments. - Strong understanding of data warehousing, ETL/ELT patterns, and best practices.Nice-to-Have Skills- Experience with streaming technologies (Kafka, Kinesis). - Knowledge of infrastructure-as-code (Terraform / CloudFormation). - Familiarity with data catalog and governance tools (AWS Glue Data Catalog, Collibra, Alation). - Exposure to ML data pipelines or MLOps frameworks.

  • Big Data Developer

    2 weeks ago

    New Delhi, India airtel Full time

    Job Title:Big Data Developer (Manager) Location: PuneExperience: 3-5 yearsJob Description: Looking for an experienced Big Data Developer to develop, maintain, and optimize our big data solutions. The ideal candidate will have strong expertise in Java, Spark, API development, and a deep understanding of data engineering and big data tools.Key...

  • Big Data Specialist

    3 days ago

    New Delhi, India Atomic North Full time

    Big Data EngineerLocation: Pune/Nagpur (WFO)Experience Required: 8+ Years**Long term onsite to Abu Dhabi**Job Summary:- We are looking for an experienced Big Data Engineer with strong expertise in PySpark and Big Data ecosystems. - The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines while ensuring high...

  • Engineer (Devops & Big Data)

    2 weeks ago

    New Delhi, India AMISEQ Full time

    SRE & Devops (Big Data)Immediate Joiner onlyBengaluru, KAExp- 3-6 YearsYou will be a member of our AI Platform Team, supporting the next generation AI architecture for various research and engineering teams within the organization.● You'll partner with vendors and the infrastructure engineering team for security and service availability● You'll fix...

  • Big Data Developer

    5 days ago

    New Delhi, India airtel Full time

    Job profiles- Big Data Developer (Senior Manager)Experience- 7-10 yrs Location- PuneJob DescriptionWe are seeking a highly skilledLead Big Data Developerto architect, drive, and optimize large-scale data engineering solutions in a modern, modular, and highly automated environment. The ideal candidate will have extensive experience in building and leading...

  • Big Data Engineer

    2 weeks ago

    New Delhi, India Alef Education Full time

    Who we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world's most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...

  • Senior Data Engineer(Big Data)

    7 days ago

    New Delhi, India Andor Tech Full time

    Andor Tech is looking for a highly skilled Senior Big Data Engineer with 8–15 years of experience to join our dynamic team. If you're passionate about big data technologies and thrive in solving complex problems, we want to hear from you!Location: Deployment to a Product-Based Retail MNCImmediate Joiners PreferredKey Skills Required:- Strong expertise in...

  • Big Data Developer

    2 weeks ago

    New Delhi, India Kresta Softech Private Limited Full time

    Role Highlights:Position: Big Data Engineer Experience:5+ years Location:Hyderabad - Hybrid Notice Period:Immediate/7 days joiners mandateJob Overview:Must have skills- Big Data, Scala, AWS and Python

  • Big Data Developer

    7 days ago

    New Delhi, India Sourcebae Full time

    Job Alert: Senior Big Data Engineer (5-8 Yrs) | Spark, Python, ScalaAre you a seasonedBig Data Engineerready to build and optimize large-scale, distributed data processing applications? We are seeking a senior engineer with5-8 yearsof experience in the core Big Data ecosystem to deliver high-performance solutions. This is a great opportunity to join a...

  • Big Data Developer

    7 days ago

    New Delhi, India IntraEdge Full time

    Role: Big Data + GCP Engineer.Location: Bengaluru, KA (Hybrid)Type: FulltimeWe are looking for energetic, high-performing and highly skilled Big Data + GCP Engineers to help shape our technology and product roadmap. You will be part of the fast-paced, entrepreneurial Enterprise Personalization portfolio focused on delivering the next generation global...

  • Big Data Engineer

    2 weeks ago

    Bengaluru, Delhi, Mumbai, NCR, India Suzva Software Technologies Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Big Data Engineer (Remote, Contract 6 Months+) ig Data ecosystem including Snowflake (Snowpark), Spark, MapReduce, Hadoop, and more.We are looking for a Senior Big Data Engineer with deep expertise in large-scale data processing technologies and frameworks. This is a remote, contract-based position suited for a data engineering expert with strong experience...