Senior Qa Automation Engineer Irc274660

We are looking for a skilled and driven Data Engineer with 4 years of experience in designing and building scalable data solutions using Databricks Apache Spark and cloud-native tools You will play a critical role in building and maintaining data pipelines that power analytics reporting and AI ML applications Requirements Experience 4-5 years of experience in data engineering with a focus on Databricks and Apache Spark Familiarity with Delta Lake for scalable data lakes and Medallion Architecture Design and implement ETL ELT pipelines on Databricks to process structured and unstructured data Work with external systems APIs and connectors to ingest and integrate data into the platform Manage real-time and batch data processing workflows Integrate data from multiple sources like cloud storage APIs databases and data lakes Programming Strong skills in Python Scala and SQL Cloud Expertise Experience with AWS Azure or GCP Tools Frameworks Knowledge of tools like Apache Airflow Data Factory or other orchestration frameworks Best Practices Proficient in data quality governance and pipeline optimization Job responsibilities Experience 4 years of experience in data engineering with a focus on Databricks and Apache Spark Familiarity with Delta Lake for scalable data lakes and Medallion Architecture Design and implement ETL ELT pipelines on Databricks to process structured and unstructured data Work with external systems APIs and connectors to ingest and integrate data into the platform Manage real-time and batch data processing workflows Integrate data from multiple sources like cloud storage APIs databases and data lakes Programming Strong skills in Python Scala and SQL Cloud Expertise Experience with AWS Azure or GCP Tools Frameworks Knowledge of tools like Apache Airflow Data Factory or other orchestration frameworks Best Practices Proficient in data quality governance and pipeline optimization What we offer Culture of caring At GlobalLogic we prioritize a culture of caring Across every region and department at every level we consistently put people first From day one you ll experience an inclusive culture of acceptance and belonging where you ll have the chance to build meaningful connections with collaborative teammates supportive managers and compassionate leaders Learning and development We are committed to your continuous learning and development You ll learn and grow daily in an environment with many opportunities to try new things sharpen your skills and advance your career at GlobalLogic With our Career Navigator tool as just one example GlobalLogic offers a rich array of programs training curricula and hands-on opportunities to grow personally and professionally Interesting meaningful work GlobalLogic is known for engineering impact for and with clients around the world As part of our team you ll have the chance to work on projects that matter Each is a unique opportunity to engage your curiosity and creative problem-solving skills as you help clients reimagine what s possible and bring new solutions to market In the process you ll have the privilege of working on some of the most cutting-edge and impactful solutions shaping the world today Balance and flexibility We believe in the importance of balance and flexibility With many functional career areas roles and work arrangements you can explore ways of achieving the perfect balance between your work and life Your life extends beyond the office and we always do our best to help you integrate and balance the best of work and life having fun along the way High-trust organization We are a high-trust organization where integrity is key By joining GlobalLogic you re placing your trust in a safe reliable and ethical global company Integrity and trust are a cornerstone of our value proposition to our employees and clients You will find truthfulness candor and integrity in everything we do About GlobalLogic GlobalLogic a Hitachi Group Company is a trusted digital engineering partner to the world s largest and most forward-thinking companies Since 2000 we ve been at the forefront of the digital revolution - helping create some of the most innovative and widely used digital products and experiences Today we continue to collaborate with clients in transforming businesses and redefining industries through intelligent products platforms and services