big data engineer data analysis

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

Basic Qualifications Bachelors degree in computer science, engineering or a related field Data: 8+ years of experience with data analytics and warehousing in Investment  & Finance Domain SQL: Deep knowledge of SQL and query optimization ELT: Good understanding of ELT methodologies and tools Troubleshooting: Experience with troubleshooting and root cause...

Design, build and maintain complex ELT jobs that deliver business value Translate high-level business requirements into technical specs Ingest data from disparate sources into the data lake and data warehouse Cleanse and enrich data and apply adequate data quality controls Provide insight and direction to guide the future development of organizations data...

Description We are seeking a skilled GCP Data Engineer to join our dynamic team in India. The ideal candidate will have extensive experience in designing, building, and maintaining data pipelines and data processing systems on Google Cloud Platform. The role involves collaborating with cross-functional teams to ensure that our data infrastructure meets the...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

Job description WHO WE ARE: You are a skilled and experienced data engineer with a strong background in data engineering Big Data. You have expertise in working with Google Big query, Apache Airflow as well as traditional ETL tools. We are looking for someone to lead the way offline for Zinnia. Your ability to lead projects and collaborate with...

Design and Develop Data Pipelines:  Hands on with development, and optimisation of scalable and reusable - data pipelines in Azure Microsoft Fabric Synapse Data Engineering  , leveraging both batch  and real-time processing techniques  . Ensure smooth integration with Azure Data Factory  for orchestration and workflow management. Cloud Data...

Your Role such as intelligent assistants, autonomous infrastructure, anomaly detection, recommendation systems, and more. Contribute to and/or lead initiatives to fine-tune and optimize LLMs (e.g., LLaMA, Mistral, GPT) using Nutanix-specific datasets. Work on RAG pipelines, embeddings, vector DBs, prompt engineering, and responsible AI guardrails....

At Centific, people are at the center of our culture.We constantly seek out opportunities for people to enhance their skills, and emphasize work-life balance for all our employees.We believe that competition can bring out the very best in people – from our annual creative film and speech contests to our weekly office game tournaments,we mix work and play...

Job Description: Design and develop robust data pipelines, ETL processes, and data integration solutions to collect, transform, and load data from various sources into our data warehouse. Collaborate with cross-functional teams to identify data requirements and translate them into technical specifications and data models. Optimize and tune database systems,...

Designing and building data pipelines to collect, process, transform, and store data from various sources. This involves understanding the data flow, selecting the appropriate technologies, and creating scalable and efficient data processing workflows. Ensure that the data pipeline architecture is reliable and produces high-quality data. This involves...

1. Designing and building data pipelines to collect, process, transform, and store data from various sources. This involves understanding the data flow, selecting the appropriate technologies, and creating scalable and efficient data processing workflows. 2. Ensure that the data pipeline architecture is reliable and produces high-quality data. This involves...

This role involves leveraging advanced data technologies to drive business outcomes in the media and advertising sector, focusing on scalability and performance optimization. Successful candidates will be adept at collaborating across teams to implement comprehensive data strategies and ensure robust, secure data management. Technical and Professional...

Cybage Software is a technology consulting organization specializing in outsourced product engineering services. Our unique offerings span the technological spectrumfrom cutting-edge software development to transformative digital strategies. In 1995, Cybage was founded with a mission to revolutionize the product engineering landscape, empowering businesses...

We are seeking an experienced GCP Data Engineer proficient in data processing frameworks, programming languages, and GCP services. The ideal candidate will have hands-on experience with cloud-based solutions, particularly GCP services such as BigQuery, Dataflow, and Spanner. Strong problem-solving abilities, a solid understanding of data security, and...

Develop and implement advanced AI/ML models to solve complex business problems and drive data-driven insights. Design, develop, and deploy machine learning algorithms and deep learning models using Python and popular frameworks like TensorFlow and PyTorch . Collaborate with cross-functional teams to understand data requirements and translate business...

Position:  Lead Data Engineer Position Responsibilities Data Engineer is responsible for developing Life Sciences content curation and delivery system for the purpose of building life sciences databases that empower CAS proprietary life sciences search technologies. This role encompasses developing and deploying scientific software solutions in the life...

We're looking for Data Engineers! Responsibilities: • Apply Machine Learning concepts and techniques to address business challenges, interpreting statistical data and identifying relevant features to inform solution development. • Choose appropriate algorithms and evaluate their performance using relevant metrics, ensuring that solutions meet business...