Big Data Expert

1 week ago

Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000
Job Title: Big Data Developer

We are seeking a highly skilled professional to design, build, and maintain robust data pipelines.

The ideal candidate will be responsible for designing end-to-end data pipelines that handle high-volume financial data.

Key Responsibilities:
  • Design and develop data pipelines for stocks, crypto, and other financial datasets.
  • Integrate APIs and data feeds into internal systems.
  • Build and optimize data ingestion, storage, and transformation workflows.
  • Ensure data quality, consistency, and reliability across all pipelines.
  • Collaborate with cross-functional teams to provide clean, structured, and scalable datasets.
  • Monitor, troubleshoot, and optimize pipeline performance.
  • Implement best practices in ETL/ELT, data governance, and security protocols.
Requirements:
  • Proven experience as a Big Data Engineer / Data Engineer in financial or crypto domains.
  • Strong expertise in Python, SQL, and distributed data systems.
  • Hands-on experience with data pipeline tools (e.g., Apache Spark, Kafka, Airflow, Flink, Prefect).
  • Experience with cloud platforms (AWS, GCP, or Azure) and data warehousing (Snowflake, BigQuery, Redshift, etc.).
  • Knowledge of API integrations and handling real-time streaming data.
  • Familiarity with databases (relational and NoSQL) and data modeling.
  • Solid understanding of stocks, cryptocurrencies, and financial data structures.
  • Strong problem-solving skills with the ability to handle large-scale data challenges.

  • Big Data Architecture Specialist

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 21,60,938 - ₹ 30,89,670

    Lead Big Data Engineer Job DescriptionWe are seeking a talented and experienced Lead Big Data Engineer to drive the development of our Enterprise TruRisk Platform.The successful candidate will be responsible for delivering roadmap features, leveraging open-source technologies, and working on challenging and business-impacting initiatives.This is a fantastic...

  • Big Data Strategist

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OpportunityWe are seeking a Senior Data Engineer to join our team. The role involves designing and developing scalable data pipelines on modern cloud & big data platforms.A strong background in Python, SQL, PySpark, Bash scripting, ETL, data pipelines, structured/unstructured data is required. Additionally, expertise in Databricks (Delta Lake, Workflows,...

  • Big Data Systems Engineer

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Data Engineering    The role of a data engineer is critical in the analytics industry. You will be responsible for designing, building, and maintaining large-scale data systems to support business intelligence.    Key Responsibilities:Design and implement scalable data pipelines using big data technologies such as Apache Spark and...

  • Cloud Era Big Data Architect

    2 weeks ago

    Solapur, Maharashtra, India beBeeBigData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data Administrator Job DescriptionThis role requires a highly skilled professional to manage our big data platform.Key Responsibilities:Administer and monitor Big Data Platform components such as Hadoop, Hive, HBase, BigSQL, etc.Support technical and application team requests for data copies across environments, data cleanup, query tuning,...

  • High-Performance Big Data Engineer

    2 weeks ago

    Solapur, Maharashtra, India beBeeBigData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Big Data DeveloperWe are seeking a skilled Big Data Developer to join our team, focusing on hands-on project support and mentoring junior engineers.You will work on live client projects, provide technical support, contribute to solution delivery, and serve as a go-to technical mentor for less experienced team members.Perform hands-on Big Data development...

  • Big Data Engineer

    2 weeks ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Unlock the Power of Big Data Analytics with Azure DatabricksAzure Databricks is a cutting-edge cloud-based platform designed for big data and analytics. As a senior data engineer, you will be responsible for crafting, deploying, and maintaining large-scale data processing systems.The ideal candidate will possess:A minimum of 5 years of experience in big data...

  • GCP Data Architect

    2 weeks ago

    Solapur, Maharashtra, India HCLTech Full time

    Role: GCP Data ArchitectTotal years of experience: 12+ YearsLocation: Noida, Bangalore, Chennai, Pune, HyderabadRelevant experience for engagement: 10 YearsRelevant skillset:Maintain architecture principles, guidelines and standardsData WarehousingProgramming Language: Python/JavaBig DataData AnalyticsGCP ServicesRelevant technology domains:Experience in...

  • Advanced Data Solutions Expert

    1 week ago

    Solapur, Maharashtra, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Senior Big Data EngineerWe build, modernize and scale intelligent products that deliver connected, AI-powered experiences.Our team specializes in delivering next-generation solutions for sectors including healthcare, technology, communications, manufacturing, and finance.The ideal candidate will have experience with Big Data analytics platforms...

  • Chief Data Architect

    2 weeks ago

    Solapur, Maharashtra, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Senior Data Engineering ProfessionalWe are seeking an exceptional data expert to drive our data engineering initiatives forward. As a key team member, you will be responsible for spearheading the design, development, and optimization of large-scale data projects.Key Responsibilities:Lead the development and continuous improvement of our data...

  • Data Analyst and Insights Expert

    2 weeks ago

    Solapur, Maharashtra, India beBeeDataScientist Full time ₹ 20,00,000 - ₹ 30,00,000

    Job Title: Data Science and Machine Learning SpecialistWe seek a skilled professional to play a crucial role in enhancing lives, communities, and the planet through innovative solutions. The ideal candidate will be responsible for extracting meaningful trends, patterns, and recommendations from raw data using data science methodologies.This position involves...