data annotations engineer

Job Overview: We are looking for an experienced Senior Data Engineer with strong expertise in designing, developing, monitoring, and optimizing scalable data pipelines. The ideal candidate should have hands-on experience with AWS, PySpark, AWS Glue, Airflow, S3/Iceberg, Redshift, and PostgreSQL . Key Responsibilities: • Design, develop, and...

Description We are seeking an experienced Azure Data Engineer to join our team in India. The ideal candidate will have a strong background in cloud data engineering, specifically with Azure technologies, and will be responsible for designing and implementing data solutions that meet the needs of our organization. Responsibilities Design, implement and...

Description As a Data Platform Engineer – Cosmos FX MIS, you will be responsible for designing, developing, and optimizing database-centric solutions for a global FX risk data platform. You will work extensively with Oracle 19c, SQL, and ETL pipelines while contributing to the platform's modernization and Azure cloud migration. The role requires...

Responsibilities Identify and evaluate opensource alternatives to licensed enterprise platforms Design reference architecture and deployment models for the new platform ecosystem Lead technical proofofconcepts and validate scalability and performance before production rollout Build Kubernetesbased data platform Required skills Platform Design Expertise...

Responsibilities Identify and evaluate opensource alternatives to licensed enterprise platforms Design reference architecture and deployment models for the new platform ecosystem Lead technical proofofconcepts and validate scalability and performance before production rollout Build Kubernetesbased data platform Required skills Platform Design Expertise...

Description We are seeking an experienced Azure Data Engineer to join our team in India. The ideal candidate will have a deep understanding of Azure data services and a proven track record of designing and implementing data solutions that meet business needs. Responsibilities Design and implement data solutions using Azure services including Azure Data...

Roles & Responsibilities: Design, develop, and maintain automation test frameworks for web, API, and data-centric applications. Perform data pipeline testing including ETL/ELT validation, schema verification, data integrity, reconciliation, and transformations across multiple sources/sinks. Implement AI/ML-powered testing solutions such as intelligent test...

Roles & Responsibilities: Design, develop, and maintain automation test frameworks for web, API, and data-centric applications. Perform data pipeline testing including ETL/ELT validation, schema verification, data integrity, reconciliation, and transformations across multiple sources/sinks. Implement AI/ML-powered testing solutions such as intelligent test...

Role: We're looking for a seasoned Data Engineer to join our Engineering organization and take ownership of the systems that power our data-driven decisions. You'll architect and maintain high-performance data pipelines and databases across platforms like MSSQL, Redshift, and Snowflake—ensuring data is reliable, accessible, and optimized for scale. If...

Key Responsibilities: Develop, maintain, and optimize data pipelines using SQL, Spark, and Python. Integrate and process data using AWS services such as Glue, Athena, and Redshift. Perform functional and automated testing of data pipelines to ensure accuracy and reliability. Monitor, debug, and perform performance tuning on existing data pipelines....

Key Responsibilities: Data Pipeline Development & Optimization Design, develop, and optimize data pipelines using Azure and Databricks. Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. Optimize Spark, SQL, and Python code for performance and scalability. CI/CD & Environment Management Hands-on work...

Key Responsibilities: Data Pipeline Development & Optimization Design, develop, and optimize data pipelines using Azure and Databricks. Build and manage scalable ELT/ETL workflows with Databricks, Delta Lake, ADF, and other Azure services. Optimize Spark, SQL, and Python code for performance and scalability. CI/CD & Environment Management Hands-on work...

Design, develop, and optimize data pipelines using Azure Synapse Analytics, Spark Pools, and Azure Data Factory. Write efficient Python and SQL code with a focus on scalability, performance, and optimization. Manage Azure Data Lake for structured and unstructured data ingestion at scale (volume, variety, velocity). Implement CI/CD pipelines and follow Data...

Pro Arch is seeking a Senior Data Engineer  with 3-5 years of experience to join our Data & Analytics practice. In this role, you will design and deliver scalable data solutions, optimize performance, and enable advanced analytics across cloud platforms. You will work with large-scale datasets, modern cloud-native technologies, and collaborate with...

We are seeking a skilled Data Engineer to join our dynamic team. The Data Engineer will be responsible for designing, developing, and maintaining our data pipelines, integrations, and data warehouse infrastructure. The successful candidate will work closely with data scientists, analysts, and business stakeholders to ensure that our data is accurate, secure,...

Job Description: Key Responsibilities: Design, develop, and maintain data pipelines and ETL/ELT workflows using Azure Data Factory, Databricks, and other Azure services. Build and manage data lake and data warehouse solutions (e.g., Azure Data Lake, Synapse Analytics). Optimize data storage, retrieval, and performance across structured and unstructured...

Key Responsibilities: Design and implement ELT processes for diverse data sources, including RDBMS, NoSQL databases, and data warehouses Develop and maintain scalable data pipelines for batch and stream processing using JVM-based languages and frameworks Collaborate with cross-functional teams to integrate diverse data sources into the data ecosystem...

We are seeking a highly experienced Senior Data Engineer with 8 years of experience in implementing Azure Data Factory, including knowledge of Databricks. You will be responsible for working on pipelines, data ingestion frameworks, and data transformation frameworks within the Azure platform. This role requires expertise in Big Data, Cloud technologies,...

Key Responsibilities Design, develop, and optimize data pipelines and ETL processes using modern data engineering tools and technologies Apply domain expertise in operations, supply chain, and manufacturing to deliver tailored data solutions Process and analyze large-scale operational datasets using frameworks like Apache Spark Implement data...

Construct and schedule automated processes and create custom processing scripts Regularly troubleshoot complex client application, integration and environment issues Troubleshoot and resolve customer data migration problems of a complex nature Thoroughly document and track production environment modifications Manage multiple projects while regularly...