Lead Large-Scale Data System Developer

2 days ago

Hubli, Karnataka, India beBeeData Full time US$ 1,00,000 - US$ 1,50,000
Senior Data Engineer Position

We are seeking a seasoned Senior Data Engineer to join our team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.

Key Responsibilities:

  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Mentor and guide junior data engineers, providing technical leadership and support.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment.

About the Company:

Our company is an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

  • Large Scale Data Engineer

    6 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time US$ 1,80,000 - US$ 2,10,000

    We seek a seasoned professional to lead our data engineering efforts. As a key member of our team, you will be responsible for designing and developing large-scale data processing systems that drive business intelligence.Key ResponsibilitiesDesign and develop scalable and robust data pipelines that collect, process, and store large volumes of structured and...

  • Large Scale Application Migration Expert

    3 days ago

    Hubli, Karnataka, India beBeeMigration Full time ₹ 15,00,000 - ₹ 25,00,000

    Lead Migration StrategistAbout the Role:The Lead Migration Strategist will play a pivotal role in spearheading the strategic migration of large-scale .NET applications to a robust Java-based ecosystem within the banking sector. This individual possesses extensive experience in both .NET and Java development, coupled with profound domain knowledge in the...

  • Large Scale Advertising Strategist

    3 days ago

    Hubli, Karnataka, India beBeeMarketing Full time ₹ 10,00,000 - ₹ 20,00,000

    Senior Advertising ProfessionalWe are seeking highly skilled professionals to lead large-scale advertising campaigns across multiple platforms.Develop and manage high-budget campaigns, driving business growth and maximizing ROI.Ensure precise budget management and optimize campaign performance.Conduct market research and competitor analysis to inform ad...

  • Large-Scale Data Platform Growth Expert – Google Cloud

    6 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Drive large-scale data platform growth on Google Cloud as a Senior Data Engineer.Key Responsibilities:Develop and implement robust data pipelines for ingestion, transformation, and analyticsBecome proficient in the GCP ecosystem and Big Data tools: Hadoop, Spark, KafkaWork with Databricks to create data-as-a-service APIsImplement scalable workflows using...

  • Senior Data Systems Engineer

    3 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    As a key member of our data-driven applications team, you will be responsible for designing and developing large-scale systems that handle complex supply chain operations, order management, and personalized customer experiences at massive scale.You will work closely with Data Scientists, Analysts, and Engineering teams to support data-driven decision-making...

  • Intelligent Systems Developer

    6 days ago

    Hubli, Karnataka, India beBeeAI Full time ₹ 2,00,00,000 - ₹ 3,00,00,000

    AI Engineering SpecialistWe are driving the future of industrial automation and engineering by developing intelligent AI agents tailored for manufacturing and automotive sectors.As part of our growing team, you'll play a key role in building robust, scalable, and intelligent AI products that redefine complex engineering workflows.Key Responsibilities:Design,...

  • Senior Apache Druid Systems Developer

    4 days ago

    Hubli, Karnataka, India beBeeDataEngineer Full time ₹ 18,00,000 - ₹ 20,10,000

    Key ResponsibilitiesAs a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems using Apache Druid.You will work closely with cross-functional teams to integrate Druid with various technologies such as Kafka, Hadoop, Spark, and Flink.The ideal candidate will have strong hands-on experience with...

  • Cloud Data Expert

    5 days ago

    Hubli, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    As a Cloud Data Expert, you will be working on various projects and opportunities involving large-scale data processing systems.The role requires designing, building, and maintaining efficient data pipelines using Azure Data Factory, Azure Database, PySpark, and SQL. You will work closely with cross-functional teams to understand business needs and develop...

  • Data Center Cooling Systems Specialist

    5 days ago

    Hubli, Karnataka, India beBeeMechanical Full time US$ 1,50,000 - US$ 2,50,000

    Are you a Mechanical Design Expert with expertise in designing mechanical solutions for hyperscale data centers?Job DescriptionWe seek an experienced professional to design innovative cooling solutions, including chilled water systems, direct expansion (DX) systems, air and liquid cooling technologies, and alternative cooling methods.Key...

  • Full-Time Lead Data Analyst Opportunity

    6 days ago

    Hubli, Karnataka, India beBeeDataAnalysis Full time ₹ 12,00,000 - ₹ 15,00,000

    Lead Data AnalystWe are looking for a highly skilled Lead Data Analyst to join our team. This is a full-time remote role where you will be responsible for leading large-scale data analysis projects, developing predictive models, and conducting statistical analysis.Proficiency in advanced data science techniques and toolsExpertise in machine learning...