
Advanced Data Pipeline Specialist
4 days ago
We are seeking a highly skilled Freelance Data Engineer to join our team. The ideal candidate will have extensive experience in designing and developing data pipelines using AWS Glue, PySpark, and Step Functions.
- The successful candidate will be responsible for implementing ETL/ELT processes for ingesting, transforming, and delivering data from multiple sources.
- They will also manage and optimize storage solutions with Amazon S3.
- Additionally, the candidate will write reusable and scalable Python code for data engineering workflows.
- Unit and integration tests will be implemented using pytest to ensure data quality and pipeline reliability.
- Effective collaboration will be required using Git/GitHub for version control, code reviews, and CI/CD integration.
- Clear technical documentation will be created for pipelines, workflows, and design decisions.
- Troubleshooting and resolving issues related to data pipelines and AWS services will be essential.
- At least 5-10 years of experience in data engineering, with at least 5 years in the AWS ecosystem.
- Strong coding skills in Python, with experience in PySpark.
- Hands-on experience with AWS Glue, Step Functions, and S3.
- Proficiency in pytest for test automation.
- Solid understanding of Git/GitHub workflows.
- Strong communication skills, with a focus on documentation and knowledge sharing.
-
Data Pipeline Architect
4 days ago
Mount Abu, Rajasthan, India beBeeAzure Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job OpportunityThreatXIntel is a cyber security company dedicated to protecting businesses and organizations from cyber threats.We are looking for an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.Design, build, and maintain scalable and efficient data pipelines using Azure Data Factory for ETL and ELT...
-
Data Pipeline Architect
4 days ago
Mount Abu, Rajasthan, India beBeeDataSpecialist Full time ₹ 1,50,00,000 - ₹ 2,50,00,000Job Description:As a technical specialist, you will be responsible for leveraging your skills in data warehousing and Azure Synapse Analytics to design, implement, and manage data pipelines.You will work closely with clients to understand their data needs and requirements, providing support and training to users on data tools and solutions.
-
Senior Data Pipeline Specialist
6 days ago
Mount Abu, Rajasthan, India beBeeData Full time ₹ 1,20,00,000 - ₹ 1,50,00,000Unlock Your Career PotentialAs a skilled professional in data engineering, you will have the opportunity to make a meaningful impact in shaping the future of data and analytics.Job Overview: We are seeking a detail-oriented Data Engineer with expertise in Azure, SQL Server, and Databricks to design, build, and manage scalable data pipelines and enterprise...
-
Data Pipeline Engineer
7 days ago
Mount Abu, Rajasthan, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000Job Title: Data Integration SpecialistAbout the Role:We are seeking an experienced data integration specialist to join our team. The successful candidate will be responsible for designing, developing, and maintaining complex data pipelines using Informatica PowerCenter.Key Responsibilities:Develop, enhance, and maintain Informatica mappings, workflows, and...
-
Data Architecture Specialist
1 week ago
Mount Abu, Rajasthan, India beBeeDataArchitecture Full time ₹ 15,00,000 - ₹ 25,00,000We're seeking a Data Architecture Specialist to support small/medium e-commerce companies on a fast growth trajectory. As an extension of their teams, you'll help them make informed decisions by implementing robust data architectures and delivering actionable insights.This role involves understanding business needs, designing scalable data models, and...
-
High-Performance Data Pipeline Specialist
7 days ago
Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 20,00,000 - ₹ 25,00,000Our Big Data Engineer role involves creating high-performance data pipelines that process massive amounts of data. You will work on optimizing our existing systems, identifying and resolving performance bottlenecks, and implementing solutions that improve the overall efficiency of our platform.Key ResponsibilitiesDesign and implement scalable batch...
-
Advanced Data Specialist
6 days ago
Mount Abu, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000**Data Engineering Role:**We are seeking a skilled Data Engineer to join our organization. The successful candidate will be responsible for designing, developing, and maintaining complex data pipelines using AWS services such as Lambda, DMS, and Glue.Data Pipeline Development: Design and develop ETL/ELT data pipelines to ingest data from various sources into...
-
Cloud Architect Data Pipeline Specialist
10 hours ago
Mount Abu, Rajasthan, India beBeeData Full time ₹ 30,00,000 - ₹ 50,00,000Job Opportunity: Azure Data EngineerWe are seeking an experienced Azure Data Engineer to join our team. The successful candidate will have a strong background in designing and implementing scalable data pipelines using Azure Databricks (PySpark/Scala) and developing and deploying Azure Function Apps for event-driven data processing and automation.The ideal...
-
Senior Data Engineer
5 days ago
Mount Abu, Rajasthan, India beBeeDataPipelines Full time US$ 1,50,000 - US$ 2,00,000Job TitleSenior Data Pipelines DeveloperKey Responsibilities: Design and develop comprehensive test cases for data pipelines using Python and Pytest.Validate data transformations, mappings, and integrity through SQL queries and data profiling.Automate functional, regression, and performance tests of data workflows to ensure pipeline reliability.Required...
-
Data Operations Specialist
3 days ago
Mount Abu, Rajasthan, India beBeeDataOperations Full time ₹ 15,00,000 - ₹ 20,00,000Join our data analytics team as a Data Operations Specialist and contribute to our mission of revolutionizing India's collections landscape.We're seeking an experienced data professional with 3-8 years of experience in data roles at operations-heavy startups. You'll design end-to-end data pipelines, develop propensity models, create real-time dashboards,...