Azure Databricks

3 weeks ago

Pune, India Braincranx IT solutions Full time

**Job description**

Sr. Data Engineer (Spark / Pyspark & Azure Data Bricks)

Skills - Data Engineering experience along with 2yrs Experience on Spark / Pyspark & Azure Data Bricks.

Roles and Responsibilities

Minimum 4+ years of Data Engineering experience.
Experience as Data Engineer in PySpark/ Spark with Azure Dataricks
Stream Analytics
Experience with Apache Kafka and event-based data
Proficient in a source code control system such as GIT
Experience with data warehousing architecture
Good understanding and experience working on Delta Lake using Apache Delta in Azure Databricks Building Data Pipelines for File, Database, and API based ingestion using different activities within and also with Data flows for any Data Transformation
Remain current with technology trends relevant to data and analytics.
Assess the benefits and risks of information by using tools such as business capability models to create an information-centric view to quickly visualize what information matters most to the organization based on the defined business strategy.
Aid in the analysis of data and analytics security requirements and solutions. Work with the security team to ensure that enterprise data and analytics assets are treated as protected assets.
Record how data is moved around the virtual enterprise, including frequency of movement, source and destination of each step, transformation, and any aggregation or calculations. Recommend any opportunities for efficiencies and improvement of data quality.
Design and define canonical data views.
Define technical standards and guidelines while encouraging the reuse of existing data stores, and addressing issues of security, timeliness, and quality. Provide guidelines for the reuse of data and ensure that the architecture management processes include the assessment of all proposals to create new data stores.

**Benefits**:

- Paid sick time
- Work from home

Schedule:

- Day shift
- Monday to Friday

Supplemental pay types:

- Commission pay
- Performance bonus

Ability to commute/relocate:

- Pune, Maharashtra: Reliably commute or planning to relocate before starting work (required)

**Experience**:

- total work: 5 years (required)

  • Azure Databricks+adf

    4 weeks ago

    Pune, India SST INDIA Full time

    VACANCY - Position: Azure Databricks+ ADF No of Position: 1 Experience Level: 8-10 year REMARK: Must have Azure Databricks +ADF Development Skills and Good to Have Azure SQL Skills. **Salary**: ₹500,000.00 - ₹800,000.00 per year Schedule: - Monday to Friday Ability to commute/relocate: - Pune, Maharashtra: Reliably commute or planning to relocate...

  • Azure Databricks

    5 days ago

    Pune, India Nityo Infotech Full time

    17 hours ago **Job Code**: JD-19482 **JOB DESCRIPTION**: Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux **Experience Required**: 5 - 9 Years **Industry Type**: IT **Employment Type**: Permanent **Location**: India

  • Azure Databricks

    3 weeks ago

    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,LinuxExperience Required5 - 9 YearsIndustry TypeITEmployment TypePermanentLocationIndia

  • Azure Databricks

    4 weeks ago

    Pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Azure Databricks

    4 weeks ago

    pune, India Nityo Infotech Full time

    Data Engineer(Databricks,NiFi,Microsoft Azure,Python,SQL,Hive,Linux Experience Required 5 - 9 Years Industry Type IT Employment Type Permanent Location India

  • Data Engineer

    3 weeks ago

    Pune/Hyderabad, IN Huquo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...

  • Data Engineer

    4 weeks ago

    Pune,Hyderabad, India HuQuo Full time

    Must-Have :- 4+ years of experience in Data Engineering experience on Azure and Databricks- Strong knowledge of Databricks, Azure Data Factory, Azure Blob, and Azure SQL is required- Experience Developing and tuning Spark Application and SparkSQL queries-- Expertise to Implementing Data warehousing Solutions - Good understanding of Azure Databricks platform...

  • Azure Data Engineer

    4 weeks ago

    Hyderabad,Pune, India Recruitment Agency Full time

    We are looking for Azure Data Engineer/ Azure Databricks.Experience : 6+ years Notice period : Immediate Requirements : - Strong proficiency in Python programming language with a focus on data processing and analytics.- In-depth experience with Azure Databricks, including cluster management, job execution, and notebook workflows.- Knowledge of big data...

  • Data Engineer

    3 weeks ago

    Pune, Maharashtra, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Data Engineer

    2 weeks ago

    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and maintaining...

  • Data Engineer

    2 weeks ago

    Pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...

  • Data Engineer

    1 week ago

    pune, India EDGESOFT Full time

    Data Engineer - DBX We are seeking a skilled Data Engineer with 4 to 5 years of experience specializing in DataBricks. The ideal candidate should have a robust understanding and hands-on expertise in PySpark and various components within DataBricks. As a crucial member of our data team, you will play a pivotal role in developing, optimizing, and...

  • Database Administrator

    3 weeks ago

    Bangalore/Hyderabad/Pune, IN iMind Your Business Solutions Private Limited Full time

    Job Description :We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India.Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data, business...

  • Database Administrator

    4 weeks ago

    Bangalore,Hyderabad,Pune, India iMind Your Business Solutions Private Limited Full time

    Job Description : We are hiring database administrators for the leaders in analytics and cloud applications, headquartered in San Francisco and with offices in India. Our client provides strategic guidance and technology systems for clients wishing to solve their most complex and interesting business challenges involving cloud applications, big data,...

  • Azure Data Architect

    3 weeks ago

    Pune, Maharashtra, India ACZ Global Pvt Ltd Full time

    Mandatory Skills : Solution is mandatoryTotal Exp : 12 yrs , relevant exp-5yearsShift Timings: 1pm to 10 pmMode of work: Hybrid- 3 Days MandatoryAzure Data ArchitectMandatory Skills - Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description:We are seeking a highly skilled and experienced Azure Data Architect to join our team....

  • Azure Data Architect

    4 weeks ago

    Pune, India ACZ Global Pvt Ltd Full time

    Mandatory Skills : Solution is mandatoryTotal Exp : 12 yrs , relevant exp-5yearsShift Timings: 1pm to 10 pmMode of work: Hybrid- 3 Days MandatoryAzure Data ArchitectMandatory Skills - Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description:We are seeking a highly skilled and experienced Azure Data Architect to join our team....

  • Azure Data Architect

    4 weeks ago

    Pune, India ACZ Global Pvt Ltd Full time

    Mandatory Skills : Solution is mandatoryTotal Exp : 12 yrs , relevant exp-5yearsShift Timings: 1pm to 10 pmMode of work: Hybrid- 3 Days MandatoryAzure Data ArchitectMandatory Skills - Solution Architecture - Pyspark + Databricks + Adf + Synapse is mandatoryJob Description:We are seeking a highly skilled and experienced Azure Data Architect to join our team....

  • Data Engineer

    3 weeks ago

    Pune/Hyderabad/Remote, IN HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data pipeline,...

  • Data Engineer

    2 weeks ago

    Pune/Hyderabad/Remote, India HARP Technologies and Services Full time

    Job Location : Pune & Hyderabad (Initial 1 -2 months hybrid and then complete remote job. Client will offer accommodation(stay), food & travel exp. )Exp range : 6+ years Shift timings : General 9am - 6pm IST or 10am - 7pm IST Mandatory skills : Data engineering (4+years), Databricks (3.5+ years), Pyspark (3+ years), Python (preferred) or bash, Data...

  • Databricks Architect/Developer

    3 weeks ago

    Pune, India Exusia Full time

    About The PositionDepartment:Sales and Delivery Team - EmpowerIndustry:Information Technology & Services, Computer Software, Management ConsultingLocation:Hyderabad, PuneExperience Range: 5+ yearsBasic Qualification:Master/Bachelor of Engineering or EquivalentTravel Requirements:Not requiredWebsite:Exusia, a cutting-edge digital transformation consultancy,...