
Senior Data Pipeline Specialist
3 days ago
We are seeking an AWS Data Engineer to design, develop and maintain data pipelines and applications using Python and PySpark.
Key Responsibilities:- Design and implement robust ETL pipelines using PySpark focusing on performance, scalability and data quality
- Create technical solutions for business requirements using AWS cloud services and Python/PySpark
- Develop applications for data manipulation, transformation and analysis using Python and PySpark
- Lead projects from planning to execution, testing and documentation
- Mentor teams in a technical environment providing solution proposals
The ideal candidate will have 5+ years of experience in data integration and pipeline development with a strong background in AWS Cloud and Apache Spark. Experience with Snowflake and Palantir Foundry is beneficial.
Required Skills and Qualifications:
- Strong understanding of AWS services including Glue, EC2, S3, EMR and Redshift
- Experience with PySpark and Python programming
- Knowledge of data integration and pipeline development
Benefits:
- Opportunity to work with a highly skilled team
- Chance to contribute to the development of innovative data solutions
- Professional growth and development opportunities
Others:
- Mentorship and guidance from experienced professionals
- Collaborative and dynamic work environment
-
Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job OverviewWe are seeking an accomplished Data Pipeline Specialist to join our team. The successful candidate will be responsible for creating and maintaining data pipelines that drive business growth.Main ResponsibilitiesCreate and implement new data pipelines to meet business needsEssential Skills and Qualifications4-6 years of experience in designing and...
-
Data Pipeline Architect
1 week ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Senior Data EngineerWe are seeking a seasoned professional to fill the role of Senior Data Engineer. The successful candidate will design and develop end-to-end data integration solutions, optimize workflows, and collaborate with stakeholders to deliver scalable and high-performing data pipelines.Develop ETL/ELT workflows using Informatica...
-
Senior Data Pipeline Specialist
7 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Job OpportunityWe are seeking a skilled data engineer to design, build, and optimize robust data pipelines for our platform.The ideal candidate will ingest, transform, and manage vast amounts of operational data from various devices, ensuring high data quality and availability for analytics and AI/ML applications.Key Responsibilities:Design scalable and...
-
Lead Data Pipeline Specialist
1 week ago
Hyderabad, Telangana, India beBeeData Full time ₹ 1,55,52,000 - ₹ 2,59,20,000Senior Data EngineerWe seek an expert in designing and maintaining large-scale data pipelines on Azure using Databricks, ADF, and PySpark. This individual will ensure high-quality, secure, and reliable datasets for analytics and customer-facing applications.Key ResponsibilitiesDesign, build, and optimise large-scale data pipelines using Databricks, Delta...
-
Data Pipeline Specialist
7 days ago
Hyderabad, Telangana, India beBeeDataPipelineManager Full time ₹ 1,00,00,000 - ₹ 2,00,00,000Job Title: Data Team LeadData Pipeline ManagerWe are seeking a seasoned data pipeline manager with experience in designing and developing robust data pipelines using Azure Databricks, Data Factory, and Datalake.The role involves overseeing the development of complex ETL solutions, managing large volumes of data, and working closely with business teams to...
-
Senior Data Pipeline Specialist
7 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 6,00,000 - ₹ 10,00,000Job Description">We are seeking a highly skilled data professional to lead our efforts in designing and maintaining efficient, scalable data pipelines and analytics platforms. The ideal candidate will have hands-on experience in Azure Data Factory, Azure Databricks, PySpark, and .NET Framework. "The selected individual will be responsible for application...
-
Lead/Senior Data Engineer
7 days ago
Hyderabad, Telangana, India Data Economy Full time US$ 1,50,000 - US$ 2,00,000 per yearWe are seeking a Lead/Senior Data Engineer with 7-12 years of experience to architect, develop, and optimize data solutions in a cloud-native environment. The role requires strong expertise in AWS Glue, PySpark, and Python with a proven ability to design scalable data pipelines and frameworks for large-scale enterprise systems. Prior exposure to financial...
-
Senior Data Operations Specialist
1 week ago
Hyderabad, Telangana, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Senior Data Operations SpecialistWe are seeking an experienced Senior Data Operations Specialist to support our data organization. This role involves maintaining data pipelines and corresponding platforms while collaborating with global teams on DataOps initiatives.Maintain day-to-day operations of data pipelines, ensuring data governance, reliability, and...
-
Data Pipeline Specialist
3 days ago
Hyderabad, Telangana, India beBeeDataEngineer Full time ₹ 8,00,000 - ₹ 12,00,000Data Engineer PositionWe are seeking a skilled data engineer to join our team. The ideal candidate will be responsible for designing, implementing, and optimizing data pipelines on our platform.Data Pipeline Development: Design, develop, and maintain scalable data pipelines using Azure Synapse, Databricks & Apache Spark (PySpark).Data Integration: Integrate...
-
Data Pipeline Specialist
2 weeks ago
Hyderabad, Telangana, India beBeeBusiness Full time ₹ 12,00,000 - ₹ 20,00,000Job Title: Business Intelligence ArchitectWe are seeking an experienced Business Intelligence Architect with a strong background in data engineering and a passion for designing, building, and optimizing scalable data pipelines.The ideal candidate will have hands-on experience in Snowflake, AWS Lambda, Glue, DBT, and SQL. They will be responsible for...