data annotations engineer

Responsibilities Strong Skill in Big Query, GCP Cloud Data Fusion (for ETL/ELT) and PowerBI. Need to have strong skill in Data Pipelines Able to work with Power BI and Power BI Reporting Design and implement the data engineering framework and data pipelines using Databricks and Azure Data Factory. Document the high-level design components of the...

Role & responsibilities Design, develop, and optimize scalable data pipelines for ETL/ELT processes. Develop and maintain Python-based data processing scripts and automation tools. Write and optimize complex SQL queries (preferably in Snowflake) for data transformation and analytics. Experience with Jenkins or other CI/CD tools. Experience developing with...

Key deliverables: Enhance and maintain the MDM platform to support business needs Develop data pipelines using Snowflake, Python, SQL, and orchestration tools like Airflow Monitor and improve system performance and troubleshoot data pipeline issues Resolve production issues and ensure platform reliability Role responsibilities: Collaborate with data...

Key deliverables: Enhance and maintain the MDM platform to support business needs Develop data pipelines using Snowflake, Python, SQL, and orchestration tools like Airflow Monitor and improve system performance and troubleshoot data pipeline issues Resolve production issues and ensure platform reliability Role responsibilities: Collaborate with data...

Handle end-to-end data pipelines from heterogeneous input and output for analytical purposes Become data architect by implementing appropriate data modeling concepts depending on data type and use cases Responsible for managing a single version of truth and turning data into critical information and knowledge that can be used to make sound business decisions...

infrastructure meets business needs and is scalable, reliable, and efficient. Key Responsibilities: 1. Team Leadership: Manage, mentor, and guide a team of data engineers, ensuring their professional development and optimizing team performance. Foster a culture of collaboration, accountability, and continuous learning within the team. Lead performance...

Evaluate, design, and implement solutions to improve cost, quality, and performance of data products Work alongside other team members promoting a DevSecOps culture Participate in data delivery and modernization initiatives for the product Provide technical guidance to peers and solve well-defined problems with little guidance What Skills You Need (Required...

The Data Engineer II works on different projects of data engineering to support the use cases, data ingestion pipeline and identify potential process or data quality issues. The team also supports marketing analytic teams with analytical tools that enable our analytics and business communities to do their job easier, faster and smarter. The team brings...

Responsibilities: Implement and maintain data quality checks and validations using various tools and techniques. Develop and execute data quality test plans and test cases. Automate data quality processes, including data profiling, data quality checks, and reporting. Contribute to the implementation and maintenance of data quality frameworks and tools....

Key Responsibilities Design and develop high-performance, scalable data pipelines using PySpark, SQL, and cloud platforms. Optimize distributed data processing for improved efficiency and reliability. Implement best practices in data modeling, architecture, and governance. Ensure data integrity, security, and compliance within cloud environments....

Designing Data Models: Utilize Kimball data modeling techniques and Data Vault 2.0 methodologies to create and maintain robust data models. Data Integration: Use Fivetran for seamless data extraction and loading, and Azure Data Factory (ADF) for orchestrating data workflows. Data Warehousing: Manage and optimize data storage in Snowflake, ensuring efficient...

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

Basic Qualifications Bachelors degree in computer science, engineering or a related field Data: 8+ years of experience with data analytics and warehousing in Investment  & Finance Domain SQL: Deep knowledge of SQL and query optimization ELT: Good understanding of ELT methodologies and tools Troubleshooting: Experience with troubleshooting and root cause...

Design, build and maintain complex ELT jobs that deliver business value Translate high-level business requirements into technical specs Ingest data from disparate sources into the data lake and data warehouse Cleanse and enrich data and apply adequate data quality controls Provide insight and direction to guide the future development of organizations data...

Description We are seeking a skilled GCP Data Engineer to join our dynamic team in India. The ideal candidate will have extensive experience in designing, building, and maintaining data pipelines and data processing systems on Google Cloud Platform. The role involves collaborating with cross-functional teams to ensure that our data infrastructure meets the...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

Job description WHO WE ARE: You are a skilled and experienced data engineer with a strong background in data engineering Big Data. You have expertise in working with Google Big query, Apache Airflow as well as traditional ETL tools. We are looking for someone to lead the way offline for Zinnia. Your ability to lead projects and collaborate with...