Senior Data Processing Specialist

1 day ago


Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 40,00,000 - ₹ 50,00,000

Job Opportunity:

  • We seek a seasoned data expert to design, develop and maintain large-scale data processing systems using Databricks and Delta Lake.
  • The successful candidate will have experience in migrating from Cloudera to Apache Spark and strong skills in Python/Scala for Spark development.
  • They will also be responsible for architecting data pipelines that ensure data quality and security best practices are followed.
  • A strong understanding of data pipeline orchestration, data governance, and cloud platforms (Azure, AWS, GCP) is essential.
  • Experience with real-time/streaming data processing is desirable.
  • Strong communication and teamwork skills are required for this role.

Key Responsibilities:

  • Develop and maintain complex data processing applications using Python/Scala for Spark development.
  • Migrate existing data pipelines from Cloudera to Apache Spark.
  • Design, develop, and maintain large-scale data processing systems using Databricks and Delta Lake.
  • Ensure data quality and security best practices are implemented.
  • Collaborate with cross-functional teams to identify and prioritize technical requirements.

Requirements:

  • Databricks Certified Associate Developer for Apache Spark (or equivalent)
  • Strong Python/Scala for Spark development
  • Experience with Delta Lake and Spark DataFrame API
  • Proven experience migrating from Cloudera to Databricks
  • Data pipeline orchestration (Databricks Jobs, Airflow, etc.)
  • Data quality and security best practices

Preferred Qualifications:

  • Databricks Certified Data Engineer Associate
  • SQL and advanced query optimization
  • Cloud platforms (Azure, AWS, GCP)
  • Real-time/streaming data processing (Spark Structured Streaming)
  • DevOps/MLOps (CI/CD, Docker, Kubernetes)
  • Experience with data governance and lineage tools


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to design, develop, and maintain large-scale data processing systems using Hadoop ecosystem, Spark, and other distributed frameworks.Key Responsibilities:Develop scalable Big Data solutions that meet business needs and drive...


  • Chennai, Tamil Nadu, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Integration SpecialistThe role of the Senior Data Integration Specialist involves designing, developing and implementing complex data integration solutions using Ab Initio's graphical interface and command-line tools.This specialist participates in design reviews, conducts code reviews, creates test plans and resolves complex...


  • Chennai, Tamil Nadu, India NTT Data Full time

    Job DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Development Senior Specialist to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).Job Description:This...


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Title: Senior Data Engineering SpecialistAbout the Role:We are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our organization. The ideal candidate will have expertise in designing, building, and maintaining robust data pipelines, optimizing data workflows, and ensuring high-quality data availability for business...


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:As a Senior Data Engineering Specialist, you will be responsible for delivering data products and performing end-to-end engineering roles. You will work effectively with fellow data engineers, product owners, data champions, and other technical experts to demonstrate technical knowledge and communication skills.


  • Chennai, Tamil Nadu, India beBeeMigration Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Senior Data Migration SpecialistWe are seeking a highly skilled data migration specialist to lead and manage comprehensive data migration initiatives across various platforms.Leverage your expertise in Teamcenter Unified Architecture, PLMXML, TCXML formats, ITK, SOA, Java, and Python scripting to automate and streamline migration activities.Design and...


  • Chennai, Tamil Nadu, India beBeeMachineLearning Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Senior AI Data Specialist">Job Description:OverviewWe are seeking a skilled and experienced Senior AI Data Specialist to support our Data Science team in delivering high-quality analytical solutions.Key ResponsibilitiesDesign, develop, validate, calibrate, document, implement, monitor, and report on a range of analytical solutionsGenerate...


  • Chennai, Tamil Nadu, India beBeeDataReconciliation Full time ₹ 13,76,000 - ₹ 22,14,000

    Job Title: Senior Data Reconciliation SpecialistWe are seeking an experienced and skilled professional to manage end-to-end data reconciliation processes. The ideal candidate will have expertise in Duco configuration, rule building, exception handling, and reporting.About the Role:Lead and manage reconciliation processes using Duco, configure rules,...


  • Chennai, Tamil Nadu, India beBeeDataProcessor Full time ₹ 4,00,000 - ₹ 8,00,000

    Job Title: Medical Data Processing Specialist">We are seeking a detail-oriented and organized Medical Data Processing Specialist to join our team.The ideal candidate will have 6 months to 3 years of experience in payment posting, demo & charge, correspondence, or charge entry.Solid knowledge of healthcare concepts is required.Responsibility Areas:Processing...


  • Chennai, Tamil Nadu, India Icon Full time

    Cardiac Data Processing Specialist - India Chennai - Hybrid Office-basedICON plc is a world-leading healthcare intelligence and clinical research organization Were proud to foster an inclusive environment driving innovation and excellence and we welcome you to join us on our mission to shape the future of clinical developmentThe Role The Cardiac Data...