
Senior Data Processing Specialist
1 day ago
Job Opportunity:
- We seek a seasoned data expert to design, develop and maintain large-scale data processing systems using Databricks and Delta Lake.
- The successful candidate will have experience in migrating from Cloudera to Apache Spark and strong skills in Python/Scala for Spark development.
- They will also be responsible for architecting data pipelines that ensure data quality and security best practices are followed.
- A strong understanding of data pipeline orchestration, data governance, and cloud platforms (Azure, AWS, GCP) is essential.
- Experience with real-time/streaming data processing is desirable.
- Strong communication and teamwork skills are required for this role.
Key Responsibilities:
- Develop and maintain complex data processing applications using Python/Scala for Spark development.
- Migrate existing data pipelines from Cloudera to Apache Spark.
- Design, develop, and maintain large-scale data processing systems using Databricks and Delta Lake.
- Ensure data quality and security best practices are implemented.
- Collaborate with cross-functional teams to identify and prioritize technical requirements.
Requirements:
- Databricks Certified Associate Developer for Apache Spark (or equivalent)
- Strong Python/Scala for Spark development
- Experience with Delta Lake and Spark DataFrame API
- Proven experience migrating from Cloudera to Databricks
- Data pipeline orchestration (Databricks Jobs, Airflow, etc.)
- Data quality and security best practices
Preferred Qualifications:
- Databricks Certified Data Engineer Associate
- SQL and advanced query optimization
- Cloud platforms (Azure, AWS, GCP)
- Real-time/streaming data processing (Spark Structured Streaming)
- DevOps/MLOps (CI/CD, Docker, Kubernetes)
- Experience with data governance and lineage tools
-
Senior Data Engineering Specialist
1 day ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior Data Engineering SpecialistWe are seeking a highly skilled and experienced Senior Data Engineering Specialist to design, develop, and maintain large-scale data processing systems using Hadoop ecosystem, Spark, and other distributed frameworks.Key Responsibilities:Develop scalable Big Data solutions that meet business needs and drive...
-
Senior Data Integration Specialist
12 hours ago
Chennai, Tamil Nadu, India beBeeDataIntegration Full time ₹ 20,00,000 - ₹ 25,00,000Job Title: Senior Data Integration SpecialistThe role of the Senior Data Integration Specialist involves designing, developing and implementing complex data integration solutions using Ab Initio's graphical interface and command-line tools.This specialist participates in design reviews, conducts code reviews, creates test plans and resolves complex...
-
Software Development Senior Specialist
4 days ago
Chennai, Tamil Nadu, India NTT Data Full timeJob DescriptionNTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Software Development Senior Specialist to join our team in Chennai, Tamil Ndu (IN-TN), India (IN).Job Description:This...
-
Senior Data Engineering Specialist
3 days ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Senior Data Engineering SpecialistAbout the Role:We are seeking a highly skilled and experienced Senior Data Engineering Specialist to join our organization. The ideal candidate will have expertise in designing, building, and maintaining robust data pipelines, optimizing data workflows, and ensuring high-quality data availability for business...
-
Senior Data Engineering Specialist
5 days ago
Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Description:As a Senior Data Engineering Specialist, you will be responsible for delivering data products and performing end-to-end engineering roles. You will work effectively with fellow data engineers, product owners, data champions, and other technical experts to demonstrate technical knowledge and communication skills.
-
Senior Data Migration Specialist
5 days ago
Chennai, Tamil Nadu, India beBeeMigration Full time ₹ 80,00,000 - ₹ 1,20,00,000Senior Data Migration SpecialistWe are seeking a highly skilled data migration specialist to lead and manage comprehensive data migration initiatives across various platforms.Leverage your expertise in Teamcenter Unified Architecture, PLMXML, TCXML formats, ITK, SOA, Java, and Python scripting to automate and streamline migration activities.Design and...
-
Senior AI Data Specialist
3 days ago
Chennai, Tamil Nadu, India beBeeMachineLearning Full time ₹ 8,00,000 - ₹ 12,00,000Job Title: Senior AI Data Specialist">Job Description:OverviewWe are seeking a skilled and experienced Senior AI Data Specialist to support our Data Science team in delivering high-quality analytical solutions.Key ResponsibilitiesDesign, develop, validate, calibrate, document, implement, monitor, and report on a range of analytical solutionsGenerate...
-
Senior Data Reconciliation Specialist
3 days ago
Chennai, Tamil Nadu, India beBeeDataReconciliation Full time ₹ 13,76,000 - ₹ 22,14,000Job Title: Senior Data Reconciliation SpecialistWe are seeking an experienced and skilled professional to manage end-to-end data reconciliation processes. The ideal candidate will have expertise in Duco configuration, rule building, exception handling, and reporting.About the Role:Lead and manage reconciliation processes using Duco, configure rules,...
-
Medical Data Processing Specialist
1 day ago
Chennai, Tamil Nadu, India beBeeDataProcessor Full time ₹ 4,00,000 - ₹ 8,00,000Job Title: Medical Data Processing Specialist">We are seeking a detail-oriented and organized Medical Data Processing Specialist to join our team.The ideal candidate will have 6 months to 3 years of experience in payment posting, demo & charge, correspondence, or charge entry.Solid knowledge of healthcare concepts is required.Responsibility Areas:Processing...
-
Cardiac Data Processing Specialist
3 weeks ago
Chennai, Tamil Nadu, India Icon Full timeCardiac Data Processing Specialist - India Chennai - Hybrid Office-basedICON plc is a world-leading healthcare intelligence and clinical research organization Were proud to foster an inclusive environment driving innovation and excellence and we welcome you to join us on our mission to shape the future of clinical developmentThe Role The Cardiac Data...