Current jobs related to Data Innovator - Hubli, Karnataka - beBeeDatabrickspyspark

  • Data Innovation Leader

    2 weeks ago

    Hubli, Karnataka, India beBeeInnovator Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Unlock Your Potential as a Data InnovatorWe're seeking an exceptional Data Engineer to drive digital transformation, deliver innovative solutions, and maximize value from data.As a key member of our team, you'll play a pivotal role in designing and building robust data foundations and end-to-end solutions that drive business outcomes. You will empower...

  • Expert Data Innovator

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Lead Data ScientistWe are seeking a highly skilled Lead Data Scientist to join our team. This role is responsible for developing and implementing data-driven solutions that drive business growth.Key Responsibilities:Design and build process automation in HERE Core Map processes employing a highly scalable Big Data infrastructure and machine...

  • Cloud Data Architect

    2 weeks ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionAs a Cloud Data Architect, you will play a key role in designing and implementing cloud-based data pipelines using AWS Databricks. This includes conceptualizing innovative solutions that drive business value through data-driven insights.The ideal candidate will have experience in handling large-scale projects involving AWS Databricks, Python,...

  • Design and Deliver Innovative Data Solutions

    2 weeks ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 1,51,00,000 - ₹ 2,01,00,000

    Job Title: Data EngineerWe are looking for a highly skilled and experienced Data Engineer to join our team. As a Data Engineer, you will play a crucial role in building strong relationships with key business stakeholders to drive engineering standards and improve outcomes across the organization.You will be responsible for designing and developing...

  • Data Internship: Join Our Quest for Innovation

    2 weeks ago

    Hubli, Karnataka, India beBeeDataInternship Full time ₹ 30,00,000 - ₹ 60,00,000

    Data Internship - Join our quest for innovation!","Immerse yourself in a world of data and AI.","","Design, build, and optimize data pipelines.","Analyze structured and unstructured datasets.","Contribute to AI-driven automation.","Support backend integration of large language models.","","Key Requirements","","Proficient in Python.","Strong understanding of...

  • AI Innovator

    1 week ago

    Hubli, Karnataka, India beBeeArtificial Full time ₹ 12,00,000 - ₹ 15,00,000

    Generative AI Model DeveloperAt the forefront of artificial intelligence, we are crafting innovative solutions to drive business growth and transformation.About the RoleThis is a full-time remote opportunity for an exceptional Generative AI Model Developer. The successful candidate will design, develop, and deploy cutting-edge AI models and algorithms,...

  • Ai Security Engineer

    3 weeks ago

    Hubli, Karnataka, India NTT DATA Full time

    Req ID 338875 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a AI Security Engineer - Shared Security Services Engineering to join our team in Banaglore Karn taka IN-KA India ...

  • Data Engineering Innovation Director

    2 weeks ago

    Hubli, Karnataka, India beBeeDataLeader Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job OverviewAs the Data Platform Engineering Lead, you will be responsible for designing and scaling the core data foundation behind our enterprise SaaS and AI-driven products.Key Responsibilities:Architect, develop, and maintain a robust semantic layer and modular dbt pipelines.Own schema design, documentation, and data contracts across the analytics and...

  • Salesforce Innovation Leader

    2 weeks ago

    Hubli, Karnataka, India beBeeInnovation Full time ₹ 18,00,000 - ₹ 21,00,000

    Job OverviewDrive Innovation in SalesforceWe are seeking an experienced professional to fill the position of Senior Lead. The ideal candidate will have a strong background in Salesforce COE, Presales, and Engineering Excellence and be passionate about driving innovation in the Salesforce space.This role focuses on R&D, building futuristic demos, Proof of...

  • Driving Cloud Data Innovation

    2 weeks ago

    Hubli, Karnataka, India beBeeDataLeader Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job Opportunity:Data Engineering Leader PositionAs a seasoned data engineering professional, you will be responsible for driving the development and implementation of scalable, secure, and compliant cloud-based data systems.Key Responsibilities include:Developing a clear platform strategy to foster business growth and operational efficiencyCollaborating with...

Data Innovator

3 weeks ago

Hubli, Karnataka, India beBeeDatabrickspyspark Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

We are seeking an experienced Data Developer to join our team as a key member of the data platform implementation team. As a key player, you will design, develop and maintain ETL processes to efficiently extract, transform and load data from various sources into the data lake and data warehouse.

Key Responsibilities:

  • ETL Development
  • Design and develop ETL processes using Databricks PySpark to extract, transform, and load data from heterogeneous sources into our data lake and data warehouse.
  • Optimize ETL workflows for performance and scalability, leveraging Databricks PySpark and Spark SQL to efficiently process large data volumes.
  • Implement robust error handling and monitoring mechanisms to proactively detect and resolve issues within ETL processes.
  • Design and implement data solutions following the Medallion Architecture principles, organizing data into Bronze, Silver, and Gold layers.
  • Ensure data is appropriately cleansed, enriched, and optimized at each stage to support robust analytics and reporting.
  • Data Pipeline Management
  • Hands-on experience in creating advanced data pipelines using Databricks workflows.
  • Develop and maintain data pipelines using Databricks PySpark, ensuring data quality, integrity, and reliability throughout the ETL lifecycle.
  • Collaborate with data engineering, data science, and business intelligence teams to translate data requirements into efficient ETL workflows and pipelines.
  • Data Analysis and Query Optimization
  • Write and optimize complex SQL queries for data manipulation, aggregation, and analysis within Databricks PySpark applications.
  • Project Coordination and Continuous Improvement
  • Participate in project planning and coordination activities to ensure timely delivery of ETL solutions.
  • Stay updated on the latest developments in Databricks PySpark, Spark SQL, and related technologies, recommending and implementing best practices and optimizations.
  • Document ETL processes, data lineage, and metadata to facilitate knowledge sharing and ensure compliance with data governance standards.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Minimum of 3 years of experience as an ETL developer, with a strong focus on Databricks PySpark development.
  • Proficiency in Python programming, with extensive experience in developing and debugging Databricks PySpark applications.
  • In-depth understanding of Spark architecture and internals, with hands-on experience in Spark RDDs, DataFrames, and Spark SQL.
  • Expertise in writing and optimizing complex SQL queries for data manipulation, aggregation, and analysis.
  • Proven experience in working with large-scale data warehousing and ETL frameworks.
  • Strong problem-solving skills and the ability to troubleshoot and resolve ETL process issues.
  • Excellent communication and collaboration skills, with the ability to work effectively in a team environment.

Priorities:

  • Experience with cloud platforms with a preference for AWS.
  • Experience with data platform tools such as DataBricks, Snowflake, and Tableau.
  • Demonstrated ability to implement best practices for ETL processes and data management.
  • Strong understanding of data governance and data quality principles.
  • Relevant certifications in Databricks PySpark, Spark SQL, or related technologies.

This role requires a highly skilled individual with expertise in data development and management. If you have a passion for working with data and driving business outcomes through data-driven insights, we encourage you to apply.

],