Senior Big Data Engineer

3 days ago

bangalore, India People Prime Worldwide Full time

About the CompanyOur client is a trusted global innovator of IT and business services, present in 50+ countries. They specialize in digital & IT modernization, consulting, managed services, and industry-specific solutions. With a commitment to long-term success, they empower clients and society to move confidently into the digital future.Title: Senior Data EngineerLocation: Hyderabad,ChennaiExperience: 6 - 12 yearsEmployment Type: PermanentNotice Period: Immediate JoinersKey Responsibilities:Big Data Processing:Design, develop, and maintain scalable ETL/ELT pipelines using PySpark, Scala, or Java.Implement data transformation workflows to ensure clean and reliable datasets.Cloud Integration:Work extensively with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS to build and manage data solutions.Data Modeling & Optimization:Develop and optimize data models in Hadoop and Spark environments.Ensure performance tuning and cost optimization of cloud-based data platforms.Data Ingestion & Integration:Ingest data from various sources including APIs, RDBMS, and NoSQL databases.Implement data pipelines for batch and real-time processing.Collaboration & Documentation:Collaborate with cross-functional teams to understand data requirements and deliver solutions.Document data models, transformation logic, and technical specifications.Automation & Monitoring:Automate data workflows and ensure data pipelines are reliable, scalable, and error-free.Implement data monitoring, logging, and alerting to ensure pipeline reliability.Required Skills & Qualifications:Technical Expertise:6–12 years of experience in Big Data engineering with strong hands-on experience in AWS, PySpark, Scala, or Java.Proficiency in SQL and experience with Hadoop ecosystem components like Hive, HDFS, and Kafka.Cloud Services:Extensive experience with AWS services such as EMR, S3, Glue, Lambda, Redshift, DynamoDB, and RDS.Data Engineering Tools:Familiarity with data orchestration tools like Apache Airflow or Oozie.Experience with containerization technologies like Docker and Kubernetes is a plus.Soft Skills:Strong analytical and problem-solving skills.Excellent communication and collaboration abilities.Ability to work independently and in a team-oriented environment.Preferred Skills (Good to Have):Certifications: AWS Certified Solutions Architect, AWS Certified Big Data – Specialty, or Cloudera Certified Associate (CCA).Experience with CI/CD pipelines using tools like Jenkins or GitLab.Knowledge of data warehousing concepts and experience with platforms like Redshift or Snowflake.Familiarity with streaming technologies such as Apache Kafka or Kinesis.

  • Senior Big Data Engineer

    2 weeks ago

    bangalore, India Veltris Full time

    Veltris is a Digital Product Engineering Services partner committed to driving technology-enabled transformation across enterprises, businesses, and industries. We specialize in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance. With a focus on innovation and acceleration, Veltris...

  • Big Data Engineer

    5 days ago

    bangalore, India Tata Consultancy Services Full time

    Job Title :- Data Engineer - PysparkExperience: 5 to 8 YearsLocation: Pune/HyderabadJob DescriptionRequired Skills:5+ years of experience in Big data and pysparkMust-HaveGood work experience on Big Data Platforms like Hadoop, Spark, Scala, Hive, Impala, SQLGood-to-HaveGood Spark, Pyspark,Big Data experienceSpark UI/Optimization/debugging techniquesGood...

  • Gcp big data engineer

    3 weeks ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Gcp big data engineer

    1 week ago

    Bangalore, India Talentmatics Full time

    We are seeking an experienced GCP Big Data Engineer with 8–10 years of expertise in designing, developing, and optimizing large-scale data processing solutions. The ideal candidate will bring strong leadership capabilities, technical depth, and a proven track record of delivering end-to-end big data solutions in cloud environments. Key...

  • Big Data Engineer

    4 days ago

    bangalore, India Alef Education Full time

    Who we areAlef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe.Today, Alef is proudly...

  • Data Engineer

    2 weeks ago

    bangalore, India Dautom Full time

    Data Engineer (Big Data, Hadoop, Spark) Location: Offshore - India (Remote) Contract Duration: 6 Months (Renewable) Client Industry: Banking/Financial Services Employment Type: Contract (Payroll: Dautom IT Consultants LLC) Notice Period: 30 days or less Experience: 6-10+ years of proven experience as a Big Data Engineer. Application Note: Independent...

  • Big Data Engineer

    3 days ago

    bangalore, India Alef Education Full time

    Who we are Alef Education began with a bold idea: that every learner deserves a personalised and meaningful education experience. What started in 2016 as a small pilot programme in Abu Dhabi has evolved into one of the world’s most dynamic EdTech companies—reshaping how millions of students engage with learning across the globe. Today, Alef is proudly...

  • Big Data Engineer – Azure

    4 days ago

    bangalore, India Innova ESI Full time

    Role: Big Data Engineer – AzureExperience: 10+ YearsLocation: Bangalore Immediate Joiners OnlyBig Data :Mandatory Skills:Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big DataOptional Skills: Airflow, PythonRoles & ResponsibilitiesOverall, experience in IT industry, including 5 years in...

  • Data Engineer

    2 weeks ago

    bangalore, India Dautom Full time

    Data Engineer (Big Data, Hadoop, Spark)Location: Offshore - India (Remote)Contract Duration: 6 Months (Renewable)Client Industry: Banking/Financial ServicesEmployment Type: Contract (Payroll: Dautom IT Consultants LLC)Notice Period: 30 days or lessExperience: 6-10+ years of proven experience as a Big Data Engineer.Application Note:Independent contractors...

  • Big data + azure engineer

    2 weeks ago

    Bangalore, India Innova ESI Full time

    Role: Big Data + Azure Engineer Location: Bangalore Experience: 12+ years Notice: Immediate Job Description: Mandatory Skills: Azure Databricks, Azure Data Factory, Azure Function apps, Apache Spark, Scala, Java, Apache Kafka, event stream and Big Data Optional Skills: Airflow, Python Roles & Responsibilities Overall, 12 years of experience in IT...