Azure Databricks

5 days ago

Pune, India Braincranx IT solutions Full time

**Job description**

Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks)

Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks.

Roles and Responsibilities

Minimum 4+ years of Data Engineering experience.
Experience as Data Engineer in PySpark/ Spark with Azure Dataricks
Stream Analytics
Experience with Apache Kafka and event-based data
Proficient in a source code control system such as GIT
Experience with data warehousing architecture
Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks Building Data Pipelines for File, Database, and API based ingestion using different activities within and also with Data flows for any Data Transformation
Remain current with technology trends relevant to data and analytics.
Assess the benefits and risks of information by using tools such as business capability models to create an information-centric view to quickly visualize what information matters most to the organization based on the defined business strategy.
Aid in the analysis of data and analytics security requirements and solutions. Work with the security team to ensure that enterprise data and analytics assets are treated as protected assets.
Record how data is moved around the virtual enterprise, including frequency of movement, source and destination of each step, transformation, and any aggregation or calculations. Recommend any opportunities for efficiencies and improvement of data quality.
Design and define canonical data views.
Define technical standards and guidelines while encouraging the reuse of existing data stores, and addressing issues of security, timeliness, and quality. Provide guidelines for the reuse of data and ensure that the architecture management processes include the assessment of all proposals to create new data stores.

**Benefits**:

- Paid sick time
- Work from home

Schedule:

- Day shift
- Monday to Friday

Supplemental pay types:

- Commission pay
- Performance bonus

Ability to commute/relocate:

- Pune, Maharashtra: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- total work: 5 years (required)

  • Azure Databricks Engineer

    3 weeks ago

    Pune, India Savi Technologies Full time

    Opening: Azure Databricks Engineer Location: Pune, Maharashtra (Onsite)Experience Range: 45 YearsApply at: - Required Skills: Azure Data Factory (ADF) PySpark Azure Databricks (ADB) SQL Job Description: We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in: Databricks engineering...

  • Azure Databricks Engineer

    1 week ago

    Pune, Maharashtra, India Savi Technologies Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Opening: Azure Databricks EngineerLocation: Pune, Maharashtra (Onsite)Experience Range: 45 YearsApply at: -Required Skills:Azure Data Factory (ADF)PySparkAzure Databricks (ADB)SQLJob Description:We're looking for an experienced Azure Databricks Engineer with a background in financial crime analytics and hands-on expertise in:Databricks engineering &...

  • Microsoft Azure Databricks

    2 weeks ago

    Pune, Maharashtra, India Artech Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Role & responsibilitiesExpected to perform independently and become an SME.- Required active participation/contribution in team discussions.- Contribute in providing solutions to work related problems.- Assist in the documentation of application processes and workflows.- Engage in continuous learning to stay updated with the latest technologies and best...

  • Microsoft Azure Databricks

    3 weeks ago

    Pune, India Artech Full time

    Role & responsibilities Expected to perform independently and become an SME.- Required active participation/contribution in team discussions.- Contribute in providing solutions to work related problems.- Assist in the documentation of application processes and workflows.- Engage in continuous learning to stay updated with the latest technologies and best...

  • Azure DataBricks Engineer

    2 weeks ago

    Pune, Maharashtra, India Wipro Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Azure DataBricks Engineer

    3 weeks ago

    Pune, India Wipro Full time

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics. Key Responsibilities Design, develop, and maintain ETL pipelines...

  • Senior Azure Databricks Engineer

    3 weeks ago

    Pune, India T&N Business Services Full time

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on Azure Role : Senior Azure Databricks Engineer Exp : 8 to 12 yrs Location : Pune/Indore Notice Period: Immediate to 30 Days Must-have skills : Azure Databricks heavy You will play a key...

  • Senior azure databricks engineer

    3 weeks ago

    Pune, India T&N Business Services Full time

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on Azure Role : Senior Azure Databricks Engineer Exp : 8 to 12 yr s Location : Pune/Indore Notice Period: Immediate to 30 Days Must-have skills : Azure Databricks heavy You will play a...

  • Senior azure databricks engineer

    3 weeks ago

    Pune, India T&N Business Services Full time

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on Azure Role : Senior Azure Databricks Engineer Exp : 8 to 12 yrs Location : Pune/Indore Notice Period: Immediate to 30 Days Must-have skills : Azure Databricks heavy You will play a key...

  • Senior Azure Databricks Engineer

    3 weeks ago

    Pune, India T&N Business Services Full time

    We seeking a talented and motivated senior Azure Data Engineer. The role will be responsible for developing solutions for risk, regulatory, and compliance projects on AzureRole : Senior Azure Databricks EngineerExp : 8 to 12 yr sLocation : Pune/IndoreNotice Period: Immediate to 30 DaysMust-have skills : Azure Databricks heavyYou will play a key role in...