Azure Databricks

10 hours ago

Pune, India Braincranx IT solutions Full time

**Job description**

Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks)

Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks.

Roles and Responsibilities

Minimum 4+ years of Data Engineering experience.
Experience as Data Engineer in PySpark/ Spark with Azure Dataricks
Stream Analytics
Experience with Apache Kafka and event-based data
Proficient in a source code control system such as GIT
Experience with data warehousing architecture
Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks Building Data Pipelines for File, Database, and API based ingestion using different activities within and also with Data flows for any Data Transformation
Remain current with technology trends relevant to data and analytics.
Assess the benefits and risks of information by using tools such as business capability models to create an information-centric view to quickly visualize what information matters most to the organization based on the defined business strategy.
Aid in the analysis of data and analytics security requirements and solutions. Work with the security team to ensure that enterprise data and analytics assets are treated as protected assets.
Record how data is moved around the virtual enterprise, including frequency of movement, source and destination of each step, transformation, and any aggregation or calculations. Recommend any opportunities for efficiencies and improvement of data quality.
Design and define canonical data views.
Define technical standards and guidelines while encouraging the reuse of existing data stores, and addressing issues of security, timeliness, and quality. Provide guidelines for the reuse of data and ensure that the architecture management processes include the assessment of all proposals to create new data stores.

**Benefits**:

- Paid sick time
- Work from home

Schedule:

- Day shift
- Monday to Friday

Supplemental pay types:

- Commission pay
- Performance bonus

Ability to commute/relocate:

- Pune, Maharashtra: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- total work: 5 years (required)

  • Azure Databricks Developer

    4 weeks ago

    Pune, Maharashtra, India People Prime World Wide Full time

    About Client :Our Client is a multinational IT services and consulting company headquartered in USA, With revenues 19.7 Billion USD, with Global work force of 3,50,000 and Listed in NASDAQ, It is one of the leading IT services firms globally, known for its work in digital transformation, technology consulting, and business process outsourcing, Business Focus...

  • Microsoft Azure Databricks

    6 hours ago

    Pune, Maharashtra, India Artech Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Role & responsibilitiesExpected to perform independently and become an SME.- Required active participation/contribution in team discussions.- Contribute in providing solutions to work related problems.- Assist in the documentation of application processes and workflows.- Engage in continuous learning to stay updated with the latest technologies and best...

  • Azure DataBricks Engineer

    3 days ago

    Pune, Maharashtra, India Wipro Full time US$ 1,00,000 - US$ 1,50,000 per year

    Role OverviewWe are looking for a seasoned Azure Data Engineer with strong experience in building and optimizing data pipelines, preferably on Azure. The candidate should be proficient in Databricks, Spark, and Python, and capable of designing scalable data solutions for big data analytics.Key ResponsibilitiesDesign, develop, and maintain ETL pipelines using...

  • Azure Databricks Engineer

    3 days ago

    Kolkata, Pune, India Savi Technologies Full time US$ 80,000 - US$ 1,20,000 per year

    Position Azure Databricks Engineer with Banking Domain Exp.Location –Pune and KolkataAzureDatabricksAMLTransactionsKYCFraud ManagementRisk ManagementCreditSQLBanking Domain ExpThanks and RegardsRajat KumarRecruitment Lead (Sales and Marketing)Savi Technologies Inc.Cell: E-Mail: -

  • Azure Databricks Architect

    1 week ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql. Role: Azure Databricks Architect Location: All Persistent Locations Experience: 12 to 17 years Job Type: Full Time Employment What You'll Do: 12+ years of experience in data architecture, data engineering, or analytics. 5+ years of...

  • Azure Databricks Architect

    5 days ago

    Pune, Maharashtra, India Persistent Systems Full time

    About Position: We are hiring for skilled Azure Databrick Architect with 12 to 17 Years of experience in python, sql.Role: Azure Databricks ArchitectLocation: All Persistent LocationsExperience: 12 to 17 yearsJob Type: Full Time EmploymentWhat You'll Do: 12+ years of experience in data architecture, data engineering, or analytics.5+ years of hands-on...

  • Azure Databricks Engineer

    3 days ago

    Pune, Maharashtra, India Symphoni Hr Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Locations:Pune, Maharashtra, IndiaMinimum Experience:5Maximum Experience:12ctc lac lac maxSkill Set:Databricks Engineer, Azure Databricks, SQL, PysparkSkill to Evaluate:Databricks Engineer, Azure Databricks, SQLExperience:5 to 12 YearsLocation:Pune, Maharashtra, IndiaJob Description:Job Title: Senior Data EngineerKey Responsibilities:- Design, build, and...

  • Big Data Engineer

    7 days ago

    Pune, Maharashtra, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Data Engineer PositionWe are seeking a highly skilled data engineer to spearhead the development of robust data solutions using Azure Databricks. The ideal candidate will possess a strong background in data engineering and be proficient in leveraging Apache Spark to build efficient data pipelines.Responsibilities include:Data Pipeline Development: Design,...

  • Azure databricks, Pyhton, Pyspark

    3 days ago

    Pune, Maharashtra, India Avertis Infotech Pvt. Ltd. Full time US$ 90,000 - US$ 1,20,000 per year

    Company DescriptionAvertis Infotech Pvt. Ltd. is an IT services company that began as an application development company specializing in integrating high-tech healthcare machinery. Today, we have expanded our expertise to various industries, adapting to the evolving business landscape. Our goal is to provide innovative solutions and exceptional services to...

  • Azure Databricks Architect

    1 day ago

    Chennai, Mumbai, Pune, India Fractal Analytics Full time

    Job DescriptionThe Impact you will have:- Handle day-to-day administration tasks such as configuring clusters and workspaces, monitor platform health, troubleshoot issues, and perform routine maintenance and upgrades.- Evaluate new features and enhancements introduced by Databricks from Security, Compliance and manageability prospective- Implement and...