
Senior Data Pipeline Specialist
6 days ago
We are seeking a highly skilled data engineer to drive our data-driven operations and decision-making in an agile environment.
The ideal candidate will have expertise in building robust data pipelines, managing data warehouses and data lakes, and integrating diverse data sources to create seamless flows of information.
Key Responsibilities:- Design, build, and maintain scalable and reliable data pipelines using AWS services like Glue and Lambda.
- Utilize workflow management tools such as Apache Airflow, Luigi, or Azkaban to orchestrate complex data flows.
- Integrate data from various sources into a centralized Data Lake and Data Warehouse.
- Hands-on experience with AWS big data platforms such as Redshift, Glue, and Lambda.
- Proficiency in writing code using the Spark engine with Python and PySpark.
- Expertise in SQL.
- Experience with data pipeline and workflow management tools like Azkaban, Luigi, or Apache Airflow.
- A business-focused approach.
- Strong consultative and management skills.
- Excellent communication and interpersonal skills.
- Certification in a cloud platform.
- Experience with Data Lakes and Data Warehouses.
-
Master Data Pipeline Specialist
1 week ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,40,000Job Title: Master Data Pipeline SpecialistAt diverse-lynx, we are seeking a highly skilled Data Engineer to design, develop, and maintain robust, scalable, and efficient data pipelines. Your primary responsibility will be to collect, process, and store structured and unstructured data from various sources.
-
Senior Data Pipeline Developer
3 days ago
Mumbai, Maharashtra, India beBeeDataPipeline Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Senior Data Pipeline DeveloperKey Responsibilities:Design and implement efficient data pipelines using IBM DataStage to extract, transform, and load data.Collaborate with data analysts and business stakeholders to deliver integration solutions.Develop reusable job components and follow best practices for data modeling.Monitor ETL jobs and manage...
-
Data Pipeline Migration Specialist
1 week ago
Mumbai, Maharashtra, India beBeeDataGovernance Full time ₹ 1,75,00,000 - ₹ 2,50,00,000Technical Leadership OpportunityThis is a senior-level position that oversees the technical aspects of implementing data pipeline migration requirements, ensuring our platform is used to its full potential through designing and building applications around business stakeholder needs.Main ResponsibilitiesCollaborate directly with stakeholders to gather...
-
Senior Data Pipeline Architect
1 week ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Transforming marketing data into actionable insights requires a unique blend of technical expertise and analytical thinking. As a key member of our data infrastructure team, you will design, develop, and maintain robust data pipelines, warehouses, and analytics platforms.Design and implement scalable data pipelines for marketing data ingestion and...
-
Data Architect and Pipeline Specialist
6 days ago
Mumbai, Maharashtra, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000Job SummaryWe are seeking a seasoned Senior Data Engineer to spearhead data engineering efforts.The successful candidate will design and develop scalable data pipelines, oversee junior data engineers, and collaborate with cross-functional teams to drive business outcomes.Key Responsibilities:Create and maintain optimal data pipeline architecture for...
-
Lead Data Pipeline Specialist
1 week ago
Mumbai, Maharashtra, India beBeeData Full time ₹ 1,20,00,000 - ₹ 2,40,00,000Senior Data EngineerWe are seeking a Senior Data Engineer to join our team. As a member of this team, you will be responsible for building data pipelines to ingest various source data from enterprise technologies and PitchBook Platform data.You will work with a range of data and reporting technologies (e.g. Python, Docker, Tableau, Power BI) to build upon a...
-
Data Pipelines Expert
4 days ago
Mumbai, Maharashtra, India beBeePipeline Full time ₹ 15,00,000 - ₹ 28,00,000Job Title: Data Pipeline SpecialistWe are seeking a highly skilled and experienced professional to join our team as a Data Pipeline Specialist. In this role, you will be responsible for designing, developing, and maintaining large-scale data pipelines that enable us to extract insights from complex datasets.Required Skills:Proficiency in cloud-based...
-
Senior Data Migration Specialist
2 weeks ago
Mumbai, Maharashtra, India beBeeDataMigration Full time ₹ 25,00,000 - ₹ 35,00,000Job TitleThe primary role of the Senior Data Migration Specialist is to oversee the technical aspects of implementing data pipeline migration requirements.Main ResponsibilitiesEngage directly with stakeholders to gather key performance indicators and business needs.Possess comprehensive knowledge of functional and technical impact analysis, as well as...
-
Pipeline Operations Specialist
21 hours ago
Navi Mumbai, Maharashtra, India beBeePipelineOperations Full time ₹ 5,00,000 - ₹ 8,00,000Job Title: Pipeline Operations SpecialistWe are seeking a skilled and experienced Pipeline Operations Specialist to join our team. In this critical role, you will play a key part in ensuring the safe and efficient operation of our pipeline networks.The ideal candidate will have a strong background in engineering and operations, with experience in managing...
-
Pipeline Data Specialist
3 days ago
Mumbai, Maharashtra, India beBeePipeline Full time ₹ 15,00,000 - ₹ 28,00,000Job OverviewWe are seeking a skilled GIS professional to support pipeline integrity projects.The ideal candidate will be responsible for extracting, processing, and validating GIS data while ensuring compliance with industry standards.Key Responsibilities:Extract GIS data from enterprise geodatabases and convert it into file geodatabases for further...