
Optimizing Data Pipeline Architecture
2 days ago
We are seeking a highly skilled Data Engineer to join our team in a 6-month remote contract based in India. As a key member of our data architecture team, you will play a critical part in designing, maintaining, and optimizing our data pipeline architecture.
You will be responsible for managing ELT processes using Stitch, including configuration, monitoring, and troubleshooting. Additionally, you will maintain and update AWS Data Migration Service (DMS) tasks for data replication from PostgreSQL to Redshift, with an emphasis on Change Data Capture (CDC) implementations.
The ideal candidate will have experience in designing, implementing, and optimizing data models within our Redshift data warehouse following best practices. You will develop and maintain data transformation pipelines using Python, dbt, AWS Lambda, and Dagster.
Responsibilities include creating and maintaining data marts for various business domains, supporting containerized applications running on AWS EKS, and collaborating with the engineering team to ensure data quality and accessibility.
Requirements:- 3+ years of experience as a Data Engineer
- Expertise in AWS services, particularly DMS and Lambda
- Proficiency in Python and database design
- Strong understanding of data warehousing and ETL concepts
- Experience with data visualization tools such as Tableau or Power BI
- A competitive salary and benefits package
- Opportunities for professional growth and development
- A dynamic and collaborative work environment
-
Data Pipeline Specialist
2 days ago
India beBeeDeveloper Full time US$ 1,04,000 - US$ 1,30,878ETL Data Engineer - Scalable Pipeline DeveloperWe are seeking an experienced ETL data engineer to build and maintain scalable data pipelines using IBM DataStage and AWS Glue. As a key member of our data engineering team, you will work collaboratively with architects, business analysts, and data modelers to ensure timely and accurate delivery of critical data...
-
Data Architectural Leader
4 days ago
India beBeeData Full time US$ 90,000 - US$ 1,20,000Big Data Engineer - BrightEdge is seeking a skilled professional to lead the design, build and maintenance of high-performance data pipelines. The ideal candidate will have extensive experience in big data technologies, Python programming skills and a strong understanding of performance optimization techniques.Job OverviewThis role is critical in ensuring...
-
Talend Data Engineer
3 days ago
India beBeeDataProfessional Full time ₹ 15,00,000 - ₹ 25,00,000We are seeking a skilled data professional with expertise in Talend Open Studio to join our organization. The ideal candidate will have experience with BigQuery, PostgreSQL, Python, and GCP.Position DetailsRole: Talend ETL DeveloperExperience: 8-10 yearsThe successful candidate will be responsible for designing and optimizing complex data pipelines using...
-
Data Pipeline Architect
1 day ago
India beBeeAzure Full time US$ 1,04,000 - US$ 1,30,878Azure Data Factory Specialist We are seeking an experienced Azure Data Factory specialist to join our team. The ideal candidate will have strong hands-on expertise in designing, building, and maintaining scalable and secure data pipelines using Azure ADF. Design, build, and maintain Azure Data Factory pipelines for ETL and ELT processes. Integrate data...
-
Data Architectural Specialist
3 days ago
India beBeeData Full time US$ 1,04,000 - US$ 1,30,878Cloud Data EngineerAbout the JobOur company is seeking a highly skilled Cloud Data Engineer with deep expertise in designing, building, and optimizing scalable data pipelines and Lakehouse architectures. You will work closely with cross-functional teams to provide thought leadership deliver robust, secure, and high-performance data solutions that empower...
-
Senior Pipeline Engineer
7 days ago
India Weekday AI Full time ₹ 15,00,000 - ₹ 20,00,000 per yearThis role is for one of Weekday's clientsMin Experience: 6 yearsLocation: IndiaJobType: full-timeWe are looking for an experienced and motivated Senior Pipeline Engineer to join our engineering team and take ownership of designing, building, and managing high-performance data pipelines. This role demands strong expertise in orchestration frameworks such as...
-
Senior Data Engineer
3 weeks ago
India Aptus Data Labs Full timeJob Title: Senior Data EngineerLocation: RemoteExperience: 4+Employment Type: Full-TimeNotice- Looking for immediate joiners or who can join within 15-20 days.About the RoleAptus Data Labs is looking for a talented and proactive Senior Data Engineer to help build the backbone of our enterprise data and AI initiatives. You'll work on modern data lake...
-
Senior Data Engineer
5 days ago
India beBeeDatabricks Full time ₹ 12,00,000 - ₹ 18,00,000Azure Databricks Engineer PositionWe are seeking a seasoned data engineer to lead our Databricks team. The ideal candidate will have extensive experience with data ingestion processes and expertise in CI/CD and Kubernetes.This role offers an opportunity to design, develop, and optimize data ingestion pipelines for integrating multiple sources into...
-
Chief Data Pipeline Architect
2 hours ago
India beBeeDataEngineer Full time US$ 1,00,000 - US$ 1,75,000Job SummaryWe are seeking an experienced senior Data Engineer to design, build and maintain robust data pipelines for processing channel activity data from multiple sources.Utilize AWS cloud infrastructure services like Pyspark, Glue, EMR, Lambda, Redshift, Athena and other services like Iceberg to implement scalable data solutions.Collaborate with...
-
Chief Data Pipeline Architect
2 days ago
India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000Data Engineering PositionWe are seeking an experienced Data Engineer to design and build scalable data pipelines, manage large datasets using Spark and SQL, and deploy real-time streaming applications.Key Responsibilities:Design and optimize data pipelines and ETL workflows.Manage and process large datasets using Spark, PySpark, and SQL.Build and maintain...