
Data Engineering Specialist
11 hours ago
Job Title: Data Engineering Specialist
We are seeking a seasoned data engineering expert with expertise in big data processing and distributed systems. The ideal candidate will have hands-on experience with Scala, Spark, Python, Apache Kafka, and NiFi.
- Design, develop, and optimize large-scale data pipelines and distributed data processing systems.
- Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.
- Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.
- Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.
The successful candidate will be responsible for designing, developing, and optimizing large-scale data pipelines and distributed data processing systems, working extensively with Scala, Spark, and Python, and developing and integrating streaming solutions using Apache Kafka and NiFi / Airflow. Experience in distributed data systems is required.
Mandatory Skills:
- Scala – Minimum 3+ years of hands-on experience.
- Strong expertise in Spark (PySpark) and Python.
- Hands-on experience with Apache Kafka.
- Knowledge of NiFi / Airflow for orchestration.
- Strong experience in Distributed Data Systems (5+ years).
- Proficiency in SQL and query optimization.
Preferred Skills:
- Exposure to messaging technologies like Apache Kafka or equivalent.
- Experience in designing intuitive, responsive UIs for data analytics visualization.
- Familiarity with Splunk or other monitoring/alerting solutions.
-
Data Engineering Specialist
2 days ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000Greetings from our companyJob Title: Data Engineering SpecialistRequired Expertise:Azure Databricks and scalable data processingScala, PySpark programming skillsAzure Cloud platform knowledgeFull Software Development Life Cycle experienceAzure DevOps and TerraformDB/SQL and database managementScala or Python development expertiseKey Responsibilities:We are...
-
Data Engineering Specialist
1 week ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job Title: Data Engineering SpecialistOverview: We are seeking a highly skilled Data Engineer to join our team. As a key member of the team, you will be responsible for designing and implementing scalable data systems that meet the needs of our business.Responsibilities:Designing and implementing RESTful/RPC API and services using Golang or...
-
Senior Cloud Data Engineering Specialist
4 days ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job OverviewWe are seeking a highly skilled Senior Cloud Data Engineering Specialist to design, implement, and optimize scalable data engineering solutions using Google Cloud Platform (GCP) services.Main Responsibilities:Design and build efficient data pipelines using BigQuery, Dataflow, DataProc, and Cloud Composer to process large-scale data.Leverage...
-
Data Flow Specialist
4 days ago
Bellary, Karnataka, India beBeeDataFlow Full time ₹ 9,00,000 - ₹ 18,00,000Key Role:Data Flow SpecialistAs a seasoned data flow specialist, you will be responsible for designing and developing data pipelines that efficiently integrate and automate data services.Main Responsibilities:Create optimized data pipelines utilizing Oracle Data Flow or Apache Spark (PySpark) to drive business outcomes.Develop strong partnerships with...
-
IoT Data Solutions Specialist
1 day ago
Bellary, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Job Title:A seasoned IoT Data Solutions Specialist is sought after to design and implement scalable data engineering solutions.Key responsibilities include developing and maintaining large-scale IoT data ingestion processing and storage architectures, utilizing Python programming to build optimize and automate data pipelines, collaborating with...
-
Cloud Data Specialist
1 day ago
Bellary, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Title: Cloud Data SpecialistA forward-thinking Cloud Data Specialist is needed to design, build, and maintain large-scale data processing systems on Microsoft Azure.Key Responsibilities:Develop scalable data pipelines using Azure services such as Data Factory, Databricks, and HDInsight.Implement data warehousing solutions using Azure Synapse Analytics...
-
Data Engineering Specialist
1 week ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Engineer">As a data engineer, you will play a key role in our organization by developing and maintaining scalable data pipelines to support continuing increases in data volume and complexity.">Our ideal candidate will have expertise in Big Data technologies such as Hadoop/HDFS, Spark, and Python. You will collaborate with analytics and...
-
Unlock Your Career as a Senior Data Engineer
1 week ago
Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000Senior Data EngineerOur team is seeking an experienced Data Engineering Professional to play a critical role in designing, building, and operating scalable data pipelines that support real-time clinical workflows. This position will work closely with software engineers, machine learning specialists, and clinical partners to bring our vision to life.
-
Data Integration Specialist
1 week ago
Bellary, Karnataka, India beBeeInformatica Full time ₹ 12,00,000 - ₹ 15,00,000Job Title: Data Integration SpecialistWe are seeking a skilled data integration specialist to join our team. The ideal candidate will have expertise in designing, developing, and testing ETL architectures for large-scale data systems.Design and develop scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured and unstructured sources,...
-
Data Ingestion Specialist
6 days ago
Bellary, Karnataka, India beBeeDataIngestion Full time ₹ 15,00,000 - ₹ 20,00,000Job Title: Data Ingestion SpecialistWe are seeking a skilled Data Ingestion Specialist to design, develop, and optimize data ingestion pipelines for integrating multiple sources into Databricks.This role requires expertise in CI/CD and Kubernetes, with a strong understanding of data ingestion processes and integration with cloud platforms.The ideal candidate...