Senior Data Processing Specialist

8 hours ago


Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000
Big Data Engineer Job Description

We are seeking a highly skilled data professional with expertise in Scala, Spark, Python, NiFi, and Apache Kafka to join our team. This is a fantastic opportunity for someone who wants to design, develop, and optimize large-scale data pipelines and distributed data processing systems.


#### Key Responsibilities:
1. Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
2. Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
3. Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
4. Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
5. Collaborate with cross-functional teams to design scalable cloud-based data architectures.
6. Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.
7. Build monitoring and alerting systems leveraging Splunk or equivalent tools.
8. Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.

#### Mandatory Skills and Qualifications:
• Scala – Minimum 3+ years of hands-on experience.
• Strong expertise in Spark (PySpark) and Python.
• Hands-on experience with Apache Kafka.
• Knowledge of NiFi / Airflow for orchestration.
• Strong experience in Distributed Data Systems (5+ years).
• Proficiency in SQL and query optimization.
• Good understanding of Cloud Architecture.

#### Why this role?
This is an exciting opportunity to work with a talented team and contribute to the development of large-scale data pipelines and distributed data processing systems. You will have the chance to work with cutting-edge technologies and collaborate with experts in the field.

  • Tiruppur, Tamil Nadu, India beBeeDataIntegration Full time ₹ 30,00,000 - ₹ 50,00,000

    Senior Data Integration SpecialistWe are seeking a seasoned Senior Data Integration Specialist to join our team. This role involves leading and executing Informatica to SSIS migration projects, ensuring accuracy, scalability, and performance.Key Responsibilities:Design and develop ETL processes for data integration and transformation.Collaborate with...


  • Tiruppur, Tamil Nadu, India beBeeBigDataExpert Full time ₹ 8,00,000 - ₹ 15,00,000

    As a seasoned data professional, you will design and implement scalable data processing systems that meet the complex needs of our business.About This Role:Develop large-scale data architectures and oversee their maintenance to ensure seamless integration with business applications.Collaborate closely with cross-functional teams to drive innovation in big...


  • Tiruppur, Tamil Nadu, India beBeeBusiness Full time ₹ 1,20,00,000 - ₹ 2,00,00,000

    Job Title: Senior Business Intelligence SpecialistWe are seeking a highly skilled Senior Business Intelligence Specialist to join our production technology team.Key Responsibilities:Design, Develop, Maintain Reports: Create data-driven insights by crafting scalable analytical workflows in a cloud-based environment using BigQuery.Write Advanced SQL Queries:...


  • Tiruppur, Tamil Nadu, India beBeeDataSpecialist Full time ₹ 9,00,000 - ₹ 15,00,000

    Job OverviewThis is a full-time role for an ETL specialist with a renowned organization.The ideal candidate will be responsible for designing, deploying, and managing data integration processes using various tools. Key tasks include utilizing ETL software, performing data modeling, ensuring data accuracy, and providing analytical insights. Additionally, the...


  • Tiruppur, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Job Title: Actuarial Data SpecialistPosition Overview:The Actuarial Data Specialist role is a key position in our team, focusing on the coordination and implementation of reporting tasks.Collaborate with teams to execute monthly/quarterly valuation reporting and analysis for various countries.Support the specification and validation of new valuation...


  • Tiruppur, Tamil Nadu, India beBeeAbinitiodeveloper Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a skilled professional to fill the position of Senior Data Integration Specialist.The ideal candidate will possess extensive experience in designing and implementing data integration solutions using Ab Initio, with a strong focus on delivering high-quality projects on time.About the Role:This is an exceptional opportunity for a...


  • Tiruppur, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    About the RoleEmbark on a data-driven journey with our manufacturing client as a Data Engineer.We're seeking an experienced professional to develop scalable pipelines, design robust frameworks, and leverage Azure Databricks and Datalake for data processing and storage.ResponsibilitiesDevelop efficient data transformation pipelines using SparkCreate scalable...


  • Tiruppur, Tamil Nadu, India beBeeDataEngineer Full time US$ 15,00,000 - US$ 18,00,000

    Marketing Data Platform SpecialistOur organization is seeking a highly skilled data engineer to assume the role of marketing platform specialist. This position entails extracting large volumes of data from various marketing platforms and processing them into pristine datasets in Snowflake, which are then used to power advanced analytics and machine learning...


  • Tiruppur, Tamil Nadu, India beBeeDataInterface Full time ₹ 10,00,000 - ₹ 18,00,000

    Job Role: Senior Data Interface SpecialistDescription:We are seeking a highly skilled data interface professional to join our team.The ideal candidate will have 4-6 years of experience in EDQ, integration development, and Oracle SQL DB, PL/SQL.Prior knowledge of JDE, PDH, CDH, SQM is preferred.The successful candidate will be responsible for designing...


  • Tiruppur, Tamil Nadu, India beBeeDataManagement Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Opportunity: Data Management SpecialistWe are seeking a detail-oriented and analytical professional to join our team as a Data Management Specialist. The role involves managing data, generating reports, and providing insights to support decision-making processes across departments.Key Responsibilities:Maintain accurate and up-to-date records of...