Expert Data Pipeline Specialist
2 days ago
We are seeking an experienced Freelance Data Engineer to design, build, and optimize large-scale data pipelines. The consultant will collaborate with internal teams and clients to ensure robust, scalable, and high-performance data solutions.
- Key Responsibilities:
- Design, develop, and maintain ETL/ELT pipelines using PySpark, AWS, and Databricks.
- Perform data profiling, validation, and transformation using Python and SQL.
- Optimize and monitor workflows for performance, scalability, and cost efficiency.
- Build automation scripts using Linux and Bash for data pipeline orchestration.
- Collaborate with analytics teams to surface trustworthy KPIs and metrics.
- Troubleshoot and resolve data inconsistencies, configuration issues, and pipeline errors.
- Work closely with cross-functional teams (analysts, product managers, engineers) to define and implement data requirements.
- Ensure thorough documentation and knowledge sharing across stakeholders.
Qualifications:
- 5+ years of data engineering experience with a strong background in Python and SQL.
- Proven expertise in PySpark, AWS services, and Databricks.
- Proficiency in Linux/Bash scripting for automation and data operations.
- Hands-on experience with ETL/ELT pipelines and large-scale integrations.
- Familiarity with Agile and CI/CD practices.
- Strong problem-solving and communication skills, with experience in client-facing roles.
-
Data Pipelining Specialist
7 days ago
Vellore, Tamil Nadu, India beBeeETLPipeliningEngineer Full time ₹ 18,00,000 - ₹ 22,00,000Job Title: Data Pipelining Engineer.We are seeking a skilled Data Pipelining Engineer to join our data engineering team. The successful candidate will be responsible for designing, developing, and maintaining scalable and efficient data pipelines using IBM DataStage (on Cloud Pak for Data), AWS Glue, and Snowflake.Key Responsibilities: Design and develop...
-
Data Pipeline Specialist
4 days ago
Vellore, Tamil Nadu, India beBeeEtl Full time ₹ 15,90,000 - ₹ 19,90,000We are seeking a skilled ETL developer to join our team. The ideal candidate will have experience in designing and optimizing complex data pipelines, debugging, and deployment using Talend.**Position Details:**- **Role:** ETL Developer- **Experience:** 8 to 10 years- **Work Timings:** Flexible schedule with evening shifts- **Duration:** 3 Months (Contract)-...
-
Senior Data Pipeline Specialist
2 days ago
Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,09,00,000About Us:We're a leading provider of telenutrition and foodcare solutions. Our platform empowers healthier food choices, drives lasting behavior change, and delivers long-term health outcomes.Our highly personalized digital platform guides users on a tailored journey to eating well while saving time and money.We integrate dietary assessments and nutrition...
-
Building Scalable Data Pipelines
3 days ago
Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 16,00,000 - ₹ 22,00,000About this JobWe are seeking a Senior Data Engineer to lead our data infrastructure initiatives. This critical role involves designing and operating scalable data pipelines that support real-time clinical workflows.Key Responsibilities:Create event-driven data pipelines integrating healthcare data from various sources.Collaborate with software engineers and...
-
Data Migration Expert
3 days ago
Vellore, Tamil Nadu, India beBeeDataMigration Full time ₹ 15,00,000 - ₹ 25,00,000Job Title: Data Migration ExpertWe are seeking a seasoned Data Migration Specialist to lead our data migration efforts. The ideal candidate will have extensive experience in developing and executing data migration strategies, as well as collaborating with cross-functional teams to drive project success.
-
Chief Data Pipeline Architect
3 days ago
Vellore, Tamil Nadu, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000Azure Data EngineerWe are seeking a skilled Azure Data Engineer to fill this key role in our organization.Key Responsibilities:Design and implement data pipelines using PySpark, SQL, and Azure Data Factory (ADF)Collaborate with stakeholders to deliver scalable data-driven outcomesWork in Agile teams to handle data validation, transformation, and...
-
Building Scalable Data Pipelines
1 day ago
Vellore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000Data Engineering Opportunities at ScaleAbout the RoleWe are seeking a seasoned Data Engineer to join our team and help drive business growth through data-driven insights. This is an exceptional opportunity to leverage your technical expertise and collaborate with talented professionals to build and optimize scalable data pipelines.Key ResponsibilitiesCreate...
-
Data Transformation Specialist
3 days ago
Vellore, Tamil Nadu, India beBeeData Full time ₹ 12,00,000 - ₹ 18,00,000Job DescriptionWe are seeking a skilled Data Specialist to design and implement robust data pipelines that transform large, complex datasets into high-quality structured information.The primary focus is to:Extract key attributes from unstructured/semi-structured documents using advanced automation techniques.Validate and check data quality with automated...
-
Data Specialist
1 day ago
Vellore, Tamil Nadu, India beBeeDataSpecialist Full time ₹ 30,00,000 - ₹ 40,00,000**Data Specialist Role** We are seeking a highly skilled professional to build high-quality datasets and visualizations for Large Language Model training. This role involves developing and maintaining data pipelines, visualization assets, and dashboards. Key Responsibilities:Develop and maintain scalable and reliable data pipelines.Build high-quality...
-
Data Integration Specialist
2 days ago
Vellore, Tamil Nadu, India beBeeIntegration Full time ₹ 20,00,000 - ₹ 25,00,000Key Integration ExpertWe are seeking a seasoned data integration specialist to join our team. The ideal candidate will have a strong background in ETL processes and databases.
