Large Scale Data Processing Expert

7 days ago

Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 6,00,000 - ₹ 12,00,000
Data Engineering Specialist

As a seasoned data expert, you will play a pivotal role in designing, building, and maintaining large-scale data processing systems. With a strong background in computer science and experience in data engineering, you will be responsible for developing and implementing efficient data pipelines, integrating with various tools and technologies, and ensuring seamless data flow across the organization.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and maintain complex data pipelines using Azure Data Factory, Data Bricks, MS Synapse, and other relevant tools to drive business value.
  • Data Integration: Develop real-time and close-to-real-time data integrations using Kafka, MS Event Hubs, and other technologies to enhance operational efficiency.
  • Business Intelligence Dashboards: Create and develop Business Intelligence Dashboards using PowerBI, Azure SQL, Azure Synapse, or similar platforms to inform strategic decision-making.
  • Collaboration: Work closely with cross-functional teams to identify business needs and develop data-driven solutions that meet stakeholder expectations.

Requirements:

  • Education: Bachelor's degree in Computer Science, Information Technology, or a related field is required, while a Master's degree is preferred for advanced roles.
  • Experience: 5+ years of experience in Data Engineering with extensive knowledge of SQL, Python, and other relevant tools is essential.
  • Skills: A strong understanding of cloud-based data engineering, data warehousing, and business intelligence is necessary for success in this role.

  • Expert Large-Scale Data Pipeline Specialist

    6 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 10,00,000 - ₹ 25,00,000

    Data Engineering OpportunityWe are seeking a seasoned Freelance Data Engineer with expertise in designing, building, and optimizing large-scale data pipelines.This role involves developing and maintaining ETL/ELT pipelines using PySpark, AWS, and Databricks. Additionally, the successful candidate will perform data profiling, validation, and transformation...

  • Large Scale Data Architect

    14 hours ago

    Bellary, Karnataka, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Architect Large-Scale Data SolutionsThe successful candidate will be responsible for designing and implementing data solutions on Snowflake, including data ingestion, transformation, and optimization.They will have hands-on experience with Snowflake utilities, SnowSQL, SnowPipe, ETL data pipelines, Big Data model techniques using Python/Java.Proficiency in...

  • Developer of Large-Scale Data Solutions

    2 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Software Engineer (Data)This is a Software Engineer position focused on data infrastructure and large-scale data processing.You will be working directly with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key insights across our data assets.ResponsibilitiesDesign and Operate Scalable Data...

  • Large Data Migration Specialist

    6 days ago

    Bellary, Karnataka, India beBeeDataIntegration Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Migration Specialist: Large Dataset IntegrationAbout the Role:We are seeking a skilled Migration Specialist to join our team. As a key member of our data integration project, you will be responsible for migrating large datasets from various sources to target platforms using advanced tools and techniques.Key Responsibilities:Execute migrations using bulk...

  • Chief Operations Director

    7 days ago

    Bellary, Karnataka, India beBeeOperations Full time ₹ 2,50,00,000 - ₹ 3,00,00,000

    Job OverviewWe seek a seasoned operations leader to spearhead large-scale service delivery management for global banking and financial clients.The ideal candidate will have 15+ years of experience in establishing, transitioning, and managing large operations teams (150+ headcount), working with multinational corporations.Key Responsibilities:Lead end-to-end...

  • Large Scale Data Engineer

    2 weeks ago

    Bellary, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description:We are looking for a skilled data engineer to join our team. The ideal candidate will have experience with designing and building robust data pipelines, as well as strong knowledge of the Google Cloud ecosystem.The successful candidate will be responsible for working with big data tools such as Hadoop, Spark, and Kafka, as well as hands-on...

  • Senior Cloud Data Solutions Expert

    16 hours ago

    Bellary, Karnataka, India beBeeData Full time ₹ 90,00,000 - ₹ 1,20,00,000

    Lead Data ArchitectA highly skilled and innovative data architect with 5+ years of experience in designing, implementing, and maintaining large-scale data storage and processing systems.Key Responsibilities:Design and ImplementationDevelop and implement scalable, performant, and cost-effective data storage solutions using Azure SQL Database, Azure Data Lake...

  • Chief Data Processing Specialist

    7 days ago

    Bellary, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Description:Key Challenges and OpportunitiesThe Senior Data Engineer will be responsible for designing, developing, and maintaining large-scale data processing workflows using Azure Databricks, PySpark, and Apache Spark.Responsibilities:Design cloud-based data architectures, including data lakes, lakehouses, and warehouses, following best...

  • Data Processing Specialist

    2 days ago

    Bellary, Karnataka, India beBeeData Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Key Responsibilities:Design, develop and maintain large-scale data processing systems.Collaborate with cross-functional teams to identify business needs and develop solutions.Ensure data quality, security and compliance.Requirements:A minimum of 10+ years or between 8-10 years or 5-8 years or 3-5 years of experience in a related field is required.Key...

  • Data Processing Specialist

    2 days ago

    Bellary, Karnataka, India beBeeDataEngineering Full time ₹ 10,00,000 - ₹ 17,50,000

    Data Engineer RoleKey Responsibilities:We are seeking a skilled Data Engineer to design, build, and maintain large-scale data processing systems.You will be responsible for developing scalable data pipelines, extracting insights from complex data sets, and providing actionable recommendations to stakeholders.Data Engineering RequirementsYou must have...