Data Engineering Specialist

2 weeks ago

Goa Jaipur, India beBeeDatabricks Full time US$ 90,000 - US$ 1,20,000

A dynamic Databricks administrator is required to lead our data engineering efforts. This pivotal role demands a deep understanding of Databricks administration, combined with experience in AWS infrastructure and data warehousing concepts.

Key Responsibilities
  • Databricks Cluster Management: Oversee the management and optimization of Databricks clusters at scale, ensuring high availability and performance.
  • Deployment & Configuration: Manage deployments within Databricks, utilizing System tables for monitoring and management.
  • Troubleshooting & Support: Provide expert troubleshooting capabilities for issues within Databricks notebooks and address Databricks-related queries from the community.
  • Cloud & Data Platform Fundamentals: Leverage knowledge of AWS services and strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
  • Coding & Automation: Utilize Spark/Python for scripting and automation within the Databricks environment.
  • Containerization & Orchestration: Work with Docker and Kubernetes.
  • AWS Services Integration: Harness expertise in relevant AWS services such as S3, Lambda, and EMR.
Required Skills & Qualifications
  • Deep understanding of AWS, Databricks, and Unity Catalog.
  • Proven experience in managing Databricks clusters and deployments.
  • Strong fundamentals of Data Warehousing (DW) / Data Lakehouse (DH) concepts.
  • Expert troubleshooting abilities within the Databricks environment.
  • Proficiency in Spark/Python.
  • Experience with Docker, Kubernetes, and AWS services (S3, Lambda, EMR).
  • Expertise in managing clusters at scale and troubleshooting within Databricks.
  • Experience working with Databricks System tables.
  • Strong knowledge of Databricks infrastructure and administration.
Benefits
  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Typically seeking candidates with 6+ years of relevant experience.
  • Certified Databricks Engineer is required.

  • Data Engineering Specialist

    1 week ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 75,00,000 - ₹ 1,50,00,000

    Job Overview">As a Data Engineering Specialist, you will design and develop robust data pipelines to drive insights and analytics for our slot games. Ensuring high-quality, reliable data is essential for player behavior analysis, game performance optimization, and data-driven decision-making.Key Responsibilities:Develop and maintain scalable data pipelines...

  • Data Engineer Specialist

    7 days ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Opportunity: Data Engineering SpecialistJob OverviewWe are seeking a skilled and results-driven data engineer to fill a key role in our growing organization. As a member of our data engineering team, you will be responsible for designing and implementing scalable, high-performance data transformation pipelines using Snowflake and dbt.Main...

  • Senior Data Engineering Specialist

    1 week ago

    Jaipur, Rajasthan, India beBeeMachineLearning Full time ₹ 15,00,000 - ₹ 24,50,000

    Job DescriptionAs a Senior Data Engineering Specialist, you will be responsible for developing and optimizing complex data pipelines using machine learning engineering principles to enhance efficiency and scalability.Develop self-running AI systems for predictive modeling by employing experimental methodologies, statistics, and machine learning...

  • SAP Master Data Specialist Job Opportunity

    7 days ago

    Goa, India beBeeMasterData Full time ₹ 18,00,000 - ₹ 21,00,000

    SAP Master Data Specialist RoleWe are seeking a detail-oriented and analytical professional to fill the role of SAP Master Data Specialist.Key Responsibilities:Maintain data integrity in our SAP-ERP system, ensuring accurate and up-to-date information is readily available to support business operations.Analyze and resolve SAP MM issues to ensure seamless...

  • Data Engineering Opportunities

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Data Engineering SpecialistAt our organization, we are seeking a skilled Data Engineering Specialist to join our team. This is an exciting opportunity for a professional with expertise in data engineering tools and technologies.Key Responsibilities:Design and develop scalable ETL workflows using Informatica BDM/DEI.Integrate data from structured...

  • Cloud Data Engineering Specialist

    7 days ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 30,00,000

    Cloud Data Engineering SpecialistWe are seeking a highly experienced Cloud Data Engineer to design, build and optimize scalable data pipelines and architectures on Google Cloud Platform.Design and implement highly scalable, reliable and secure data pipelines on GCP using Google Cloud Storage, BigQuery and Apache Airflow.Develop robust ETL/ELT processes using...

  • Data Integration Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataIntegration Full time ₹ 1,27,16,400 - ₹ 2,54,32,800

    Job Title: Data Integration SpecialistWe are seeking an experienced data integration specialist to take on a key role in our organization. The ideal candidate will possess a strong background in testing and analysis, with a proven ability to work efficiently and effectively.Must have at least 8 years of experience in test engineering, preferably with a focus...

  • Data Insights Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataInsights Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Insights SpecialistWe are seeking a highly skilled Data Insights Specialist to lead our business intelligence unit in India. This role will focus on driving growth and profitability objectives through portfolio and business analytics.Key Responsibilities:Data Analysis & Modelling: Ensure accuracy, validity, and robustness of analytical...

  • Data Engineering Specialist

    2 weeks ago

    Jaipur, Rajasthan, India beBeeDataEngineering Full time ₹ 14,40,000 - ₹ 21,60,000

    **Job Title:** Data EngineerJob Description:As a key member of our team, the Data Engineer will be responsible for designing and implementing data pipelines using Python and AWS (S3, Redshift, Lambda, Glue). The ideal candidate will have a strong background in ETL processes and data warehousing concepts.Required Skills and Qualifications:Developing and...

  • Data Engineering Specialist

    1 week ago

    Jaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 19,00,000

    Job Description:We seek a seasoned data professional to craft, implement and maintain intricate data pipelines.The ideal candidate will have in-depth knowledge of workflow orchestration, data integration, and data quality assurance.AirflowPythonSnowflakeKey Skills:Responsibilities: Design and implement complex data pipelines using AirflowCollaborate with...