Data Engineer-Data Platforms-Azure-DLT

1 day ago

Bengaluru Hyderabad Pune, India Gravity Engineering Services Full time ₹ 20,00,000 - ₹ 25,00,000 per year

Job Description:

8+ Yrs total experience in IT/Data Engineering projects & 5+ years of

relevant experience- Strong coding skills in - Python, SQL, ADF, Databricks (PySpark, Delta

live table, Live/structural data streaming, Unity Catalog, Performance Tuning of DLT

pipelines with high volume of data processing , Cost Optimization of Databricks when DLT

runs in live streaming on Photon, Serverless, non serverless)The candidate should be

responsible, take ownership, self driven, dedication to achieve timeline. Should have great

problem solving and analytical/reasoning capability,Technical skill with good mindset and

behaviour is important good hands-on programming / scripting knowledge in Python , very

strong skilled resources only with good communication-knowledge in Power BI

AWS/Azure/SAP - Master

ELT - Master

Data Modelling - Master

Data Integration & Ingestion - Skill

Data Manipulation and Processing - Skill

GITHUB, Action, Azure DevOps - Skill

Data factory, Databricks, SQL DB, Synapse, Stream Analytics, Glue, Airflow, Kinesis,

Redshift, SonarQube, PyTest - Skill

Required skills-Python, SQL, Databricks, ADF within-Databricks - DLT, PySpark, Structural

streaming, performance and cost optimization

Azure : Azure data factory, ADLS- Azure data lake store, Azure data bricks,

Mandatory Programming languages: Py-Spark, PL/SQL, Spark SQL, Python Programming,

Data Modelling and design

Database : SQL DB

Experience with Azure: ADLS, Databricks, Stream Analytics, SQL DW, COSMOS DB,

Analysis Services, Azure Functions, Serverless Architecture, ARM Templates,

Experience with relational SQL and NoSQL databases, including Postgres and Cassandra.

Experience with object-oriented/object function scripting languages: Python, SQL, Scala,

Spark-SQL etc.

Data Warehousing experience with strong domain knowledge Nice to have experience with

big data tools: Hadoop, Spark, Kafka, etc.

Nice to have experience with data pipeline and workflow management tools: Azkaban, Luigi,

Airflow, stream processing systems: Storm, Azure Synapse/CI/CD

optional: COSMOS DB, Synapse Analytics, Azure analysis services

  • Senior Databricks engineer(DLT

    2 weeks ago

    Hyderabad, India Zentek Infosoft Full time

    Job Description - Bachelors or master's degree in computer science, Engineering, or a related field. - 10+ years of overall experience and 8+ years of relevant in Data bricks, DLT, Py spark and Data modelling concepts-Dimensional Data Modelling (Star Schema, Snowflake Schema) - Proficiency in programming languages such as Python, Py spark, Scala, SQL. -...

  • Azure Data Engineer

    1 week ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Azure Data Engineer

    4 weeks ago

    Pune, India Fragma Data Systems Full time

    Job Description Technology Skills - Building and operationalizing large scale enterprise data solutions and applications using one or more of AZURE data and analytics services in combination with custom solutions - Azure Synapse/Azure SQL DWH, Azure Data Lake, Azure Blob Storage, Spark, HDInsights, Databricks, CosmosDB, EventHub/IOTHub. - Experience in...

  • Apply in 3 Minutes! Azure Data Engineer

    1 week ago

    Hyderabad, India Enable Data Incorporated Full time

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Data Engineer

    2 weeks ago

    Bengaluru, Karnataka, India NTT DATA Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    As a Data Engineer, your main responsibilities will involve: The project is a migration of a SAS code to DBT code, so it's important that the candidate has experience in this type of projects. Analyze data models and derive logical conclusions. Processes modeling. Hands on development and monitoring of the Azure cloud Platform and various associated...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Persistent Systems Full time

    About Position:We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Persistent Systems Full time

    About Position:We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using...

  • Senior Data Engineer

    2 weeks ago

    Pune, India Persistent Systems Full time

    About Position:We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using...

  • Senior data engineer

    2 weeks ago

    Pune, India Persistent Systems Full time

    About Position:We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using...

  • Senior data engineer

    1 week ago

    Pune, India Persistent Systems Full time

    About Position:We are seeking a highly skilled and experienced Data Engineer with expert-level proficiency in Azure Databricks, Apache Spark, and Azure Data Services. The ideal candidate will have a strong background in building production-grade Delta Live Tables (DLT) pipelines, implementing Medallion Architecture, and managing infrastructure using...