Data Ingestion Specialist

Job DescriptionData Pipeline Management and ValidationBuild and manage ingestion workflows using Spark, Hive, Trino, and Kafka.Validate data ingestion, debug pipeline outputs, and support delta loads.Create and schedule Airflow DAGs for recurring ingestion processes.Automation and Scripting ExpertiseUtilize Python and Bash (or PowerShell) to automate...

Join Our Data Engineering TeamWe are seeking a skilled Associate Software Engineer II to join our data engineering team. As a key member of our team, you will play a crucial role in developing and deploying scalable data ingestion mechanisms for generative AI-powered solutions.This is an exciting opportunity to work with cutting-edge technology and...

About our Data Team:We're building a data-driven platform for the finance sector.Role:You'll help create and maintain data ingestion systems that process financial documents, supporting real-time data solutions.Responsibilities:Design scalable data collection pipelinesImplement automated web data extraction solutionsCollaborate with cross-functional...

Job Summary:We are seeking a seasoned Data Transformation Specialist to join our organization.About the Role:This position involves designing and implementing scalable, high-performance data transformation pipelines using Snowflake and dbt.The ideal candidate will have experience in building ingestion pipelines from various sources, managing environments,...

Req ID: 339839NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Collibra Specialist to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Job Duties: Produce data mapping...

Job Title: Data Integration SpecialistWe are seeking a highly skilled Data Integration Specialist to join our team.Develop and implement data replication, synchronization, and mass ingestion solutions using IICS.Design and develop ETL processes leveraging SQL expertise.Collaborate with Agile/Scrum development teams in the Retail domain.Key...

Data EngineerWe are seeking a talented individual to fill the role of Data Engineer. This position requires good knowledge of Python and SQL (Snowflake) as well as experience in designing, developing and evaluating software and systems.Apply engineering principles to design, develop and evaluate software and systemsImplement software for specifications of...

Job Title: Advanced Cloud Data SpecialistData Ingestion and ProcessingData Warehousing SolutionsCloud Platform Expertise

Job Title: Senior Web Scraping EngineerThis is a high-throughput product data ingestion pipeline opportunity across hundreds of domains.Key Responsibilities:Design and build an HTTP-first crawler with Playwright fallback for JS-heavy pagesImplement sitemap diffing and conditional GETs for incremental runsBuild a lightweight 'needs JS?' classifier to...

Job Title: Data Engineering SpecialistWe are seeking a highly skilled Data Engineering Specialist to join our team. This role will be responsible for designing, building, and maintaining large-scale data processing systems.Key Responsibilities:Data Ingestion: Develop and implement data ingestion pipelines using Azure Databricks (ADB) and Azure Data Factory...