Current jobs related to Data Pipeline Specialist - Hyderabad, Telangana - beBeeDataPipelineManager
-
Data Pipeline Specialist
1 week ago
Hyderabad, Telangana, India beBeeProfessional Full time ₹ 18,00,000 - ₹ 24,00,000Job OverviewThe Software Professional will design, build, and maintain complex data pipelines, datasets, dataflows, integration runtimes, and monitor pipeline executions using Azure Data Factory and Azure Synapse.Key ResponsibilitiesExtract, transform, and load (ETL) data from source systems and process large datasets using Azure Databricks.Develop advanced...
-
Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000Data Engineer PositionWe are seeking a skilled data engineer to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate...
-
Data Pipeline Quality Engineer
1 week ago
Hyderabad, Telangana, India beBeePerformance Full time US$ 6,00,000 - US$ 10,80,000Job Overview:We seek a highly skilled Quality Assurance Specialist with 5-10 years of professional experience to ensure the integrity, reliability, and performance of data pipelines and AI/ML solutions within our SmartFM platform.Key Responsibilities:
-
Principal Data Pipelines Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,00,00,000Job Description">Robust Data Pipelines Engineer">We are seeking an experienced engineer to design, build, and optimize robust data pipelines for our SmartFM platform.">Key Responsibilities:">">Design, develop, and maintain scalable and efficient data ingestion pipelines from diverse sources using technologies like StreamSets, Azure Data Factory, Apache...
-
Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job DescriptionWe are seeking an experienced Data Engineer to join our team. The ideal candidate will have a strong background in designing and implementing data pipelines, as well as experience with big data tools such as HDFS/S3, Spark/Flink, Hive, HBase, Kafka/Kinesis, etc.A strong understanding of relational SQL and NoSQL databases, including...
-
Cloud Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Job TitleData Engineer Position OverviewWe are seeking an experienced data engineer to lead the development of scalable data pipelines using Apache Spark and PySpark. The ideal candidate will have a deep understanding of cloud-based data processing and hands-on experience with AWS services.Develop and maintain robust ETL/ELT pipelines on AWS using Spark and...
-
Senior Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 25,00,000We are seeking an AWS Data Engineer to design, develop and maintain data pipelines and applications using Python and PySpark.Key Responsibilities:Design and implement robust ETL pipelines using PySpark focusing on performance, scalability and data qualityCreate technical solutions for business requirements using AWS cloud services and Python/PySparkDevelop...
-
Lead Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Job Summary:We are seeking a skilled Data Engineer with a strong background in data pipeline architecture, integration, and transformation techniques.Key Responsibilities:Design, develop, test, and maintain scalable ETL data pipelines using Python.Work extensively on Google Cloud Platform (GCP) services such as:Dataflow for real-time and batch data...
-
Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeReliability Full time ₹ 15,00,000 - ₹ 19,99,900Job Title: Data Reliability EngineerWe are seeking a highly skilled and experienced Data Reliability Engineer to join our team.Key Responsibilities:Design and implement reliable data pipelines using DatabricksDevelop and maintain scalable data infrastructure using Python and SQLCollaborate with cross-functional teams to ensure data quality and...
-
Data Pipeline Engineer
1 week ago
Hyderabad, Telangana, India beBeeData Full time ₹ 10,00,000 - ₹ 13,00,000Job Title: Data Pipeline Tester We are seeking an experienced professional to test our data pipelines, ensuring seamless data flow and accurate data processing. As a key member of our team, you will play a vital role in identifying and resolving data pipeline issues, collaborating closely with developers and data engineers to implement fixes. The ideal...
Data Pipeline Specialist
2 weeks ago
Job Title: Data Team Lead
Data Pipeline ManagerWe are seeking a seasoned data pipeline manager with experience in designing and developing robust data pipelines using Azure Databricks, Data Factory, and Datalake.
The role involves overseeing the development of complex ETL solutions, managing large volumes of data, and working closely with business teams to deliver high-quality data transformations and analytics solutions.
Main Responsibilities:
- Design and develop efficient ETL pipelines for data ingestion and transformation.
- Collaborate with Azure stack modules like Data Lakes and SQL DW to build scalable data solutions.
- Write optimized SQL, Python, and PySpark code for data processing and transformation.
- Translate business requirements into technical designs and lead cross-functional teams to implement them.
- Develop comprehensive mapping documents and transformation rules as per project scope.
- Communicate project status with stakeholders, ensuring smooth project execution and timely delivery.
Key Qualifications:
- 7-10 years of experience in data ingestion, data processing, and analytical pipelines for big data and relational databases.
