databricks data engineer

Key deliverables: Enhance and maintain the MDM platform to support business needs Develop data pipelines using Snowflake, Python, SQL, and orchestration tools like Airflow Monitor and improve system performance and troubleshoot data pipeline issues Resolve production issues and ensure platform reliability Role responsibilities: Collaborate with data...

Role Overview: We are seeking street-smart and technically strong Senior Data Engineers / Leads who can take ownership of designing and developing cutting-edge data and AI platforms using Azure-native technologies and Databricks. You will play a critical role in building scalable data pipelines, modern data architectures, and intelligent analytics...

Developing and maintaining data models that define the structure, relationships, and constraints of data within enterprise data model Creating and implementing data pipelines and ETL processes to move and transform data from various sources into data storage solutions like data warehouses or data lakes Implementing measures to ensure the accuracy, integrity,...

Should be able to design (high level / low level) software solutions for the new requirements. Coding independently and with other team members with proper software industry standard best practices. Collaborate with data analysts/ product managers in understanding the data. - Work closely with Data Analysts and QA (Quality Assurance) teams and deliver the...

Role & responsibilities Integral team member of our Data Engineering team responsible for design and development of Big data solutions Partner with domain experts, product managers, analyst, and data scientists to develop Big Data pipelines in Hadoop or Snowflake Responsible for delivering data as a service framework Responsible for moving all legacy...

Unnesting of JSON files in Google BigQuery Google Cloud Run (using container services, python) Hands on experience in GCP services like composer, cloud function, cloud run Experience in developing CI/CD pipelines. Experience in DBT scripts, docker files and knowledge on datavault is a plus. Strong technical knowledge and hands on experience of python or java...

Job Summary As a Data Engineer, you will be responsible for establishing and optimizing the flow of data throughout the organization while ensuring its security. Executing end-to-end data pipeline, from designing the technical architecture, and developing the application to finally testing and implementing the proposed solution. The Data Engineer is...

About the Role As a Senior Data Engineer , you will become part of a cross-functional development team focused on engineering the data experiences of tomorrow. This role is ideal for someone passionate about scalable data systems, eager to solve complex problems, and ready to work in a dynamic environment. Responsibilities Build and prototype scalable data...

About the Role As an Expert Data Engineer , you will be part of a cross-functional development team dedicated to building innovative, scalable data solutions that drive tomorrow's experiences. You will design and maintain large-scale data infrastructure, work closely with analysts and data scientists, and contribute to internal technical communities....

About the role: As a Data Science Engineer, become a part of a cross-functional development team who is working with a leading enterprise AI SaaS company for digital transformation across the most critical and resilient growth industries, including retail, consumer packaged goods, financial crime prevention, manufacturing, media, and IT service management....

Responsible for developing data integration processes to support Paychex data initiatives aimed at assuring accuracy and consistency of critical business data across Paychex systems. Requires depth and breadth of experience in data and database technologies including proficient SQL and software development. Provides technical support during critical and...

We are looking for smart & creative candidates who want to Learn and Grow, and to Innovate because they love the challenge of solving business problems Join our team of Engineers and be a part of our reforming BusinessNext Platform Within this realm of cutting-edge technology, you'll play a pivotal role in shaping the future of digital innovation on a global...

Qualification 3-5 Years of overall IT experience as a Data Engineer with hands on expertise in building data pipeline, data transformation and metadata creation involving large complex and disconnected data sets. Graduate in Computer Science, Statistics, Informatics, Information Systems or another quantitative field Data Engineering Certification from GCP. ...

About the Company : `Headquartered in California, U.S.A., GSPANN provides consulting and IT services to global clients. We help clients transform how they deliver business value by helping them optimize their IT capabilities, practices, and operations with our experience in retail, high-technology, and manufacturing. With five global delivery centers and...

Jade Global Software Pvt. Ltd. is looking for Snowflake Data Engineer to join our dynamic team and embark on a rewarding career journey. Snowflake Data Engineer is responsible for overseeing and optimizing snowflake data engineer operations. This role involves strategic planning, team coordination, and execution of tasks to ensure efficiency and...

Analyse existing software solutions for training and deployment and identify limitations. Design, develop, test, and deploy software solutions that address the above limitations and enable deployment in a heterogeneous cluster. Collaborate with a global team in developing such solutions. Minimum Qualifications Bachelor's degree in engineering with 2-5...

Job Summary:   As a Data Platform Engineer, you will be responsible for assisting with the blueprint and design of the data platform components using Databricks Unified Data Analytics Platform. Your typical day will involve collaborating with Integration Architects and Data Architects to ensure cohesive integration between systems and data models.  ...

Key Responsibilities : Work in an Agile/SCRUM environment with a seasoned data engineering team. Design, develop, test, and debug large-scale data infrastructure. Build and migrate to a modern Data Lake & ETL infrastructure . Develop data APIs and delivery services for operational and analytical applications. Drive automation and optimization of internal...

About This Role Bounteous x Accolite is a premier end-to-end digital transformation consultancy dedicated to partnering with ambitious brands to create digital solutions for today's complex challenges and tomorrow's opportunities. With uncompromising standards for technical and domain expertise, we deliver innovative and strategic solutions in Strategy,...

Designing and building data pipelines to collect, process, transform, and store data from various sources. This involves understanding the data flow, selecting the appropriate technologies, and creating scalable and efficient data processing workflows. Ensure that the data pipeline architecture is reliable and produces high-quality data. This involves...