Distributed Data Architect

1 day ago

Mumbai, Maharashtra, India beBeeData Full time ₹ 12,00,000 - ₹ 20,00,000

Big Data Engineer Opportunity

\

Are you a skilled data engineer looking for a challenging role? We're seeking an experienced professional to join our team as a Big Data Engineer.

\

The ideal candidate will have a strong background in Scala, Spark, and Python, with hands-on experience in distributed data systems and cloud-based solutions. They should be proficient in designing, developing, and optimizing large-scale data pipelines and distributed data processing systems.

\

We're looking for someone who can work independently and collaboratively as part of a cross-functional team. The successful candidate will have excellent problem-solving skills, a keen eye for detail, and the ability to communicate complex ideas effectively.

\

Responsibilities:

\
  • \
  • Design, develop, and optimize large-scale data pipelines and distributed data processing systems.\
  • Work extensively with Scala, Spark (PySpark), and Python for data processing and transformation.\
  • Develop and integrate streaming solutions using Apache Kafka and orchestration tools like NiFi / Airflow.\
  • Write efficient queries and perform data analysis using Jupyter Notebooks and SQL.\
  • Collaborate with cross-functional teams to design scalable cloud-based data architectures.\
  • Ensure delivery of high-quality code through code reviews, performance tuning, and best practices.\
  • Build monitoring and alerting systems leveraging Splunk or equivalent tools.\
  • Participate in CI/CD workflows using Git, Jenkins, and other DevOps tools.\
  • Contribute to product development with a focus on scalability, maintainability, and performance.\
  • Mandatory Skills:\
    • \
    • Scala - Minimum 3+ years of hands-on experience.\
    • Strong expertise in Spark (PySpark) and Python.\
    • Hands-on experience with Apache Kafka.\
    • Knowledge of NiFi / Airflow for orchestration.\
    • Strong experience in Distributed Data Systems (5+ years).\
    • Proficiency in SQL and query optimization.\
    • Good understanding of Cloud Architecture.\
    • Preferred Skills:\
      • \
      • Exposure to messaging technologies like Apache Kafka or equivalent.\
      • Experience in designing intuitive, responsive UIs for data analytics visualization.\
      • Familiarity with Splunk or other monitoring/alerting solutions.\
      • Hands-on experience with CI/CD tools (Git, Jenkins).\
      • Strong grasp of software engineering concepts, data modeling, and optimization techniques.\

  • Data Warehouse Architect

    1 day ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 1,00,00,000 - ₹ 1,50,00,000

    Database Data ArchitectWe seek an experienced Database Data Architect to join our team. Key Responsibilities:Lead the design and implementation of large-scale, distributed database architectures.Collaborate with cross-functional teams to develop and implement data warehousing solutions.Develop and maintain data quality standards and procedures.Design and...

  • Data Architect

    3 weeks ago

    Mumbai, Maharashtra, India Quantiphi Full time

    Role: Technical Architect - DataExperience Level: 10 to 15 YearsWork location: Mumbai, Bangalore, Trivandrum (Hybrid)Notice Period: AnyRole & Responsibilities:More than 8 years of experience in Technical, Solutioning, and Analytical roles.5+ years of experience in building and managing Data Lakes, Data Warehouse, Data Integration, Data Migration and Business...

  • Data Integration Architect

    3 weeks ago

    Mumbai, Maharashtra, India Reliance New Energy Full time

    The Global Power Market is amidst a fundamental transition from a central Predictable vertically integrated one way to a distributed Intermittent horizontally networked bidirectional model with increasing penetration of Renewables playing a key role in this transition RILs newly created Distributed Renewables RE business intends to accelerate this...

  • Senior Distributed Systems Architect

    15 hours ago

    Mumbai, Maharashtra, India beBeeSoftwareEngineer Full time US$ 1,50,000 - US$ 2,50,000

    Job DescriptionWe are seeking an experienced Software Engineer to lead our team in developing and implementing scalable, high-performance distributed services/systems.This role involves managing data integration and analysis across disparate systems, building extensible data acquisition and integration solutions, and providing expertise in problem-solving...

  • Data Architect

    1 day ago

    Mumbai, Maharashtra, India beBeeData Full time US$ 1,20,000 - US$ 2,00,000

    Job Title: Data ArchitectWe are seeking a highly skilled and experienced Data Architect to lead our data engineering efforts. This is an excellent opportunity for someone who has a passion for building and maintaining scalable and efficient data pipelines, as well as optimizing databases for high-performance analytics.

  • Big Data Solutions Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job Description:This role involves the design, development and implementation of end-to-end big data solutions using MapR, Apache Hadoop and associated ecosystem tools.The incumbent will lead data platform modernization efforts including architecture reviews, platform upgrades and migrations.A strong understanding of distributed systems, high availability...

  • Data Architect

    5 days ago

    Mumbai, Maharashtra, India beBeeData Full time ₹ 8,00,000 - ₹ 12,00,000

    Job Title: Visionary Data ArchitectAbout the Role:We are seeking a seasoned and innovative Data Architect to spearhead our data strategy, ensuring seamless integration across various systems. As a key member of our team, you will design and implement robust data pipelines, facilitate collaboration among stakeholders, and drive business growth through...

  • Kam - Rural Distribution

    2 days ago

    Mumbai, Maharashtra, India Sun Pharmaceutical Industries Full time

    Role KAM - Rural Distribution Experience 8 to 15 years of filed experience Qualification Any degree good to have MBA Therapy Department Rural distribution - sales Industry Preference Pharma OTC FMCG Job Location Sun House Mumbai Areas of responsibilities Financial Achieve Super Stockist channel secondary and primary Achieve sub level...

  • Solution Architect

    3 weeks ago

    Mumbai, Maharashtra, India Quantiphi Full time

    Role : Solutions Architect – AWS Data & Analytics Location: Mumbai / Bangalore Experience: 7+ years Are you a cloud data enthusiast with a passion for architecting scalable and modern solutions on AWS? We're looking for a Solutions Architect to join our high-impact engineering teams at Quantiphi . What You'll Do: Act as a trusted advisor to clients...

  • Power Distribution Specialist

    3 days ago

    Mumbai, Maharashtra, India beBeeDistribution Full time ₹ 15,00,000 - ₹ 25,00,000

    **Power Distribution Engineer Role:**Job Description:As a Power Distribution Engineer, you will play a crucial role in designing and preparing layouts and reports for power distribution projects. You will utilize your technical expertise in distribution design tools and commitment to quality standards to drive results.Key Responsibilities:Design and Layout:...