Data Engineer(data Bricks)

1 day ago

Bangalore Karnataka, India NR Consulting Full time

Title Data Engineer Data Bricks Location Bangalore Exp 4 Yrs Job Descrition Key Responsibilities Design and develop ETL data pipelines using Databricks and Apache Spark Optimize and manage Spark-based workloads for scalability and performance Work with structured and unstructured data from multiple sources Implement Delta Lake for data reliability and ACID transactions and Unity Catalog for centralized governance and cataloging service in Databricks Develop and maintain SQL-based transformations queries and performance tuning Collaborate with data engineers analysts and business teams to meet data requirements Implement job orchestration using Airflow Databricks Workflows or other scheduling tools Ensure data security governance and compliance best practices Monitor debug and resolve performance bottlenecks in Databricks jobs Work with cloud storage solutions AWS S3 Required Skills Experience Strong experience in Databricks and AWS Hands-on experience with Python PySpark Scala SQL Experience with Spark performance tuning and optimization Knowledge of Delta Lake Lakehouse Architecture and Medallion Architecture Familiarity with orchestration tools Airflow Databricks Workflows Hands-on experience with data modeling and transformation techniques Experience with cloud platform AWS Proficiency in CI CD for Databricks using Git DevOps tools Strong understanding of data security governance and access control in Databricks Good knowledge of APIs REST services and integrating Databricks with external systems Preferred Qualifications Databricks Certification Databricks Certified Associate Professional Knowledge of BI tools like Power BI Looker ThoughtSpot Bachelor s or Master s degree in Computer Science Information Systems Engineering or equivalent 4 to 6 years of experience

  • Data bricks

    2 weeks ago

    bangalore, India People Prime Worldwide Full time

    Job Title: Data bricks· Location: Pune · Experience: 10 · Mode of Work : Hybrid · Job Type : Contract to hire. · Notice Period: Immediate joiners. · Project Tenure: Long-term projectJD:- Fluency in Azure Databricks and Azure Data Factory- Knowledge of Azure cloud services- Proficiency in any ETL and reporting tools, such as Databricks (preferable) and...

  • Data bricks

    2 weeks ago

    bangalore, India People Prime Worldwide Full time

    Job Title: Data bricks · Location: Pune · Experience: 10 · Mode of Work : Hybrid · Job Type : Contract to hire. · Notice Period: Immediate joiners. · Project Tenure: Long-term project JD: - Fluency in Azure Databricks and Azure Data Factory - Knowledge of Azure cloud services - Proficiency in any ETL and reporting tools, such as Databricks (preferable)...

  • Lead Data Architect

    4 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Lead Data Architect to join our team in Bangalore Karnxc4x81taka IN-KA India IN Position Overview We are seeking a highly...

  • Data Engineer

    2 days ago

    Bangalore, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant 5+ years into Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts

  • Data Engineer

    2 days ago

    Bangalore Urban, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location.Looking for candidates with 5 to 7 years of experienceRelevant 5+ years into Data Engineering GCP Cloud Data bricks,Unity catalog, Python/Pyspark Terra form scripts

  • Data Engineer

    3 days ago

    Bangalore Urban, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant 5+ years into Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts

  • Data Modeler

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Req ID**: 312266 We are currently seeking a Data Modeler (Data Governance) to join our team in Bangalore, Karnātaka (IN-KA), India (IN). **Title: Data Modeler (Data Governance)** **Position Overview**: **Key Responsibilities** - Develop and maintain conceptual, logical, and physical data models aligned with organisational data governance frameworks. -...

  • Data Scientist

    6 days ago

    Bengaluru, Karnataka, India NTT DATA Full time

    **Make an impact with NTT DATA** Join a company that is pushing the boundaries of what is possible. We are renowned for our technical excellence and leading innovations, and for making a difference to our clients and society. Our workplace embraces diversity and inclusion - it’s a place where you can grow, belong and thrive. **Your day at NTT DATA** The...

  • Azure Data Engineer

    3 weeks ago

    Bangalore, Karnataka, India Arcadis Full time

    T-SQL SSIS SSAS SSRS Azure Data Factory Azure Data Lake Store Azure Data Lake Analytics Good to have not mandatory Azure SQL DB Azure SQL DW Azure Analysis Services DAX Azure Data Bricks with Python Scala Experience in building end to end solution using Azure data analytics platform Experience in building generic framework solution which can be reused for...

  • Data Engineer

    7 days ago

    bangalore, India Landmark Group Full time

    Landmark Group is looking for a Azure Data Engineers with 5-8 years of experience to join the Data Team in Landmark Digital. As a Data Engineer, you will take a pivotal role in designing, deploying, and optimizing data solutions leveraging Azure's powerful ecosystem. Your expertise will drive the development of efficient data pipelines using Azure Data...