Current jobs related to Building Modern Data Pipelines with AWS and Hudi - Remote - Xpetize Technology Solutions
-
Xpetize - Data Engineer - Python/SQL
3 weeks ago
Remote, India Xpetize Technology Solutions Full timeXpetize hiring Data Engineer with Remote opportunitySkills : Data engineerLocation : RemoteExperience : 4+ yearsNotice : Immediate onlyKey skills : - Data Engineering Expertise : Bring 3+ years of experience in building data pipelines and managing a secure, modern data stack. This includes CDC streaming ingestion using tools like Debezium into a Hudi data...
-
Data Engineer for Modern Data Architectures
7 days ago
Remote, India Infiniti Research Full timeAbout Infiniti Research:Infiniti Research is a global analytics and advisory firm with offices worldwide. We have assisted clients across the globe with advanced analytics, visual storyboarding, Machine Learning, and data engineering solutions implementation for prudent decision making.We are a rapidly growing organization that is built and operated by...
-
Data Pipeline Specialist
7 days ago
Remote, India Fractal31 Pvt Ltd Full timeAbout UsWe are Fractal31 Pvt Ltd, a leading provider of data engineering services. Our team of experts has a proven track record of delivering high-quality solutions to our clients, and we are now looking for an experienced Data Engineer to join our team.In this role, you will be responsible for:Migrating legacy data workloads to modern cloud...
-
Data Engineer
3 weeks ago
Remote/India SheThink Pvt. Ltd. Full timeRole : AWS Data Engineer. Good To Have Skills : AWS Certifications. Must Have Skills : Client Management, Pyspark, Glue, EMR Cluster, Lamda, DMS, ETL, AWS. Experience Level : 8-12 Years. Employee Type : Salaried.The Data platform associate will work in a variety of settings to build the data systems including design, implementation, ongoing maintenance, and...
-
Data Pipeline Development Expert
7 days ago
Anywhere in India/Multiple Locations/Remote GFL Recruitment Private LimitedZigsaw Full timeResponsibilitiesThe successful candidate will be responsible for designing, developing, and maintaining large-scale data pipelines and architectures using AWS and Azure cloud platforms. This includes:Designing and implementing data storage solutions using AWS S3 or Azure Blob Storage.Utilizing AWS Redshift or Azure Synapse Analytics to design and optimize...
-
Aws Data Architect
4 days ago
Remote, India RARR Technologies Pvt Ltd Full time**Key Responsibilities**: - Design end-to-end data solutions on AWS, emphasizing Databricks and Python for data processing. - Develop scalable and efficient data architectures to meet business objectives. - Utilize AWS cloud services for architecting and implementing data solutions. - Optimize data processing and storage using various AWS services. - Lead...
-
Aws Data Architect
4 days ago
Remote, India RARR Technologies Pvt Ltd Full timeDevelop end-to-end data solutions on AWS, specializing in Spark and Scala technologies. - Create scalable and efficient data architecture to meet current and future business requirements. - Utilize AWS cloud services, including EMR, Glue, Lambda, and S3, to architect and implement data solutions. - Optimize data processing and storage through effective use...
-
AWS Data Engineer
3 weeks ago
Anywhere in India/Multiple Locations/Remote GFL Recruitment Private LimitedZigsaw Full timeExp : 5+ years Notice Period : Immediate Location : Remote Job Description : - Design, develop, and maintain scalable and efficient data pipelines using AWS Glue or Azure Data Factory to extract, transform, and load data from various sources. - Implement data storage solutions using AWS S3 or Azure Blob Storage, ensuring data accessibility, security, and...
-
Data Engineer
3 weeks ago
Remote, India Uncap Research Labs Full timeJob Description : The Data Engineer will be responsible for designing and building modern data platforms to support data-driven decision making. The Data Engineer will execute technical implementation of data engineering and visualization projects.The Data Engineer will help build a data and analytics consulting practice by taking part in recruiting efforts,...
-
Data Engineer
1 week ago
Remote, India Yo HR Consultancy Full timeTitle: Data Engineer (Technical Lead)Experience : 8 years to 14 yearsWork Mode: Remote Job Description : As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt ,...
-
Python with Aws
3 days ago
Remote, India Codex Tech-IT LLC Full timeDescription Note Key Responsibilities: - Implement and manage CI/CD pipelines using Git, facilitating continuous integration and deployment of software solutions. - Work collaboratively with cross-functional teams to identify and resolve technical challenges. - Leverage AWS services effectively to build and scale reliable distributed systems. Basic...
-
Data Engineer
7 days ago
Remote, India Fractal31 Pvt Ltd Full timeRoles and Responsibilities : Cloud Migration : Manage the migration of legacy data workloads to modern cloud platforms, ensuring data quality, security, and optimal performance. Data Science Support : Build client data pipelines from diverse sources to support data science applications, collaborating closely with data scientists to address data requirements....
-
Data Engineer
3 weeks ago
Remote, India Innovistors Technological Solutions Pvt Ltd Full timeAs a Data Engineer you'll be :- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture- Mentoring Fother Junior Engineers in the Team- Be a "go-to" expert for data technologies and...
-
Data Engineer
4 weeks ago
Remote, India Yo HR Consultancy Full timeTitle: Data Engineer (Technical Lead)Experience : 8 years to 14 yearsWork Mode: Remote Job Description : As part of the team, you will be responsible for building and running the data pipelines and services that are required to support business functions/reports/dashboard.. We are heavily dependent on BigQuery/Snowflake, Airflow, Stitch/Fivetran, dbt ,...
-
Data Engineer
3 weeks ago
Remote, India FANISKO PRIVATE LIMITED Full timeJob Title : Data Engineer with AIML Expertise Years of Experience : 3+ years Qualifications : Any UG/PG Location : Remote Employment Type : Contract / Full-Time Employment (FTE) Required by Date : Immediate start Share your profiles to Job Description : - Data Pipeline Development : Design, implement, and maintain scalable and efficient data pipelines for...
-
AWS Data Engineer
2 weeks ago
Anywhere in India/Multiple Locations/Remote Ampstek Full timeResponsibilities :- Design, develop, and maintain core data pipelines using Python and Airflow on the AWS cloud platform.- Collaborate with cross-functional teams (data analysts, product managers, business intelligence) to understand data needs and translate them into technical solutions.- Implement data quality checks, lineage monitoring, and alerting to...
-
Data Engineer
4 weeks ago
Remote, India Innovistors Technological Solutions Pvt Ltd Full timeAs a Data Engineer you'll be :- Developing end to end ETL/ELT Pipeline working with Data Analysts of business Function.- Designing, developing, and implementing scalable, automated processes for data extraction, processing, and analysis in a Data Mesh architecture- Mentoring Fother Junior Engineers in the Team- Be a "go-to" expert for data technologies...
-
AWS Support Engineer
2 days ago
Remote, India Rackspace Technology Full timeJob DescriptionL3 AWS Support EngineerJob Description:As an L3 AWS Support Engineer, you will be responsible for providing advanced technical support for complex AWS-based solutions. You will troubleshoot and resolve critical issues, architect solutions, and provide technical leadership to the support team.Key Responsibilities:Architectural Oversight:Design,...
-
Aws Architect
7 days ago
Remote, India KUTIR Full time**Job Title: AWS Principal Architect** **Location: Remote** **Duration: Fulltime / Permanent** **Mandate Pointers to be focused**: - 70% -- Solutioning / Technical Architecting including Presales Support - 30% -- Overseeing existing and new opportunities Deliverables **Required Skills & Experience**: - Requires BA/BS in Mathematics, Computer Science,...
-
Senior Data Architect
7 days ago
Remote, India Fractal31 Pvt Ltd Full timeJob OverviewWe are seeking a highly skilled Data Engineer to join our team at Fractal31 Pvt Ltd. This role will involve designing, developing, and maintaining large-scale data systems, as well as collaborating with cross-functional teams to drive business outcomes.The ideal candidate will have expertise in cloud-based data engineering, including experience...
Building Modern Data Pipelines with AWS and Hudi
1 week ago
Xpetize Technology Solutions is looking for a talented Data Engineer to build and maintain our modern data infrastructure. In this role, you will design and implement data pipelines using Apache Hudi and CDC streaming ingestion tools like Debezium.
About the Role:This position requires expertise in cloud and data infrastructure, with a strong focus on security and scalability. You will work closely with our data analytics team to ensure seamless integration with our AI/ML workflows and analytical platforms.
Key Responsibilities:- Implement data engineering solutions using Python, SQL, and dbt on AWS cloud infrastructure.
- Collaborate with cross-functional teams to ensure effective data governance practices and compliance.
- Stay up-to-date with industry trends and advancements in data engineering, ensuring our data platform remains competitive and innovative.
- Develop and deploy data pipeline solutions using CI/CD best practices.
- A dynamic and supportive work environment with opportunities for growth and professional development.
- A comprehensive benefits package, including health insurance, retirement plans, and paid time off.
- The chance to work on challenging projects and contribute to the success of our company.