Big Data Platform Architect

2 weeks ago

Chennai Pune Mumbai, India beBeeData Full time ₹ 15,00,000 - ₹ 28,00,000
About This Role

We are seeking an experienced Data Platform Architect to join our team. The successful candidate will have a proven track record of designing and implementing scalable, secure, and high-performance data platforms using Databricks.

  • As a Data Platform Architect, you will be responsible for the day-to-day administration of our Databricks environment, including configuring clusters, monitoring platform health, troubleshooting issues, and performing routine maintenance and upgrades.
  • You will also evaluate new features and enhancements introduced by Databricks from a security, compliance, and manageability perspective.
  • In addition, you will implement and maintain security controls to protect the Databricks platform and the data within it, collaborating with the security team to ensure compliance with data privacy and regulatory requirements.
  • You will optimize the platform's performance by monitoring resource utilization, identifying and resolving bottlenecks, and fine-tuning configurations for optimal performance.
  • Furthermore, you will work closely with data analysts, data scientists, and other users to understand their requirements and provide technical support.
  • You will automate platform deployment, configuration, and monitoring processes using scripting languages and automation tools, collaborating with the DevOps team to integrate the Databricks platform into the overall infrastructure and CI/CD pipelines.
Requirements

To be successful in this role, you will need:

  • A minimum of 11 to 16 years of experience in Big Data Technologies, such as Apache Spark, cloud-native data lakes, and data mesh platforms, in a technical architecture or consulting role.
  • Strong experience in administering and managing Databricks or other big data platforms, specifically on Azure cloud.
  • Proficiency in Python programming.
  • Skills in technical areas that support the deployment and integration of Databricks-based solutions.
  • Knowledge of the latest services offered by Databricks and the ability to evaluate these services and understand how they can fit into the platform.

  • Enterprise Big Data Architect

    7 days ago

    Pune, Maharashtra, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Enterprise Big Data ArchitectJob DescriptionWe are seeking an experienced Enterprise Big Data Architect to lead the design, development and deployment of large-scale big data systems. As a key member of our team, you will be responsible for architecting and implementing scalable, secure and high-performance big data solutions using Hadoop, Spark,...

  • Big Data Architect

    2 weeks ago

    Pune, Maharashtra, India beBeeBigDataEngineer Full time US$ 1,20,000 - US$ 1,75,000

    Senior Big Data EngineerAs a seasoned Big Data Engineer, you will be responsible for architecting and building large-scale data pipelines using Apache Spark and Databricks.Key Responsibilities:Design and implement complex data pipelines to process and analyze large datasets.Develop expertise with streaming systems such as Apache Kafka and Confluent...

  • Senior Big Data Solutions Architect

    2 weeks ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Big Data Solutions Architect RoleWe are seeking a seasoned Big Data Solutions Architect to join our team. The successful candidate will have a deep understanding of big data technologies and be able to design, develop, and implement scalable solutions.Key Responsibilities:Design and implement data platforms using Databricks Unified Data Analytics...

  • Big Data Architect

    2 weeks ago

    Pune, India Ellicium Full time

    What are we about? At Ellicium be ready for contagious excitement, worthy challenges and enriching learning experience every day. We trust in the process of failing fast and learning fast. You will find ‘Ellicians’ putting their heart to get the perfect dish during our monthly potlucks or arguing over best Nolan movie during lunch breaks. It is all about...

  • Big Data Architect

    2 days ago

    Pune, India Talent Velocity Full time

    Job Title : Big Data ArchitectExperience : 8+ YearsLocation : Nagpur / Pune (Onsite 5 Days Working)Notice Period : 0 to 30 days maxAbout the Role :We are looking for a highly skilled Big Data Architect to design and deliver scalable, production-grade big data solutions integrating Hadoop ecosystems with cloud platforms. The ideal candidate will have...

  • Gdc Big Data Architect

    2 weeks ago

    Pune, India Cranium IT Inc Full time

    skill: Exp: 10+ years Joining: immediate to max 30 days JD: design of SDP data platform, - 8+ years of experience - Hands-on experience in Big Data (Cloudera - Hadoop, Spark, etc.) - Hands-on experience in stream processing (RT/NRT) - Apache Kafka, NiFi and similar - Strong background in developing and utilizing tools that prepare, extract and manipulate...

  • Big Data/Cloud Architect

    2 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time

    Advanced Data Analytics. Global Delivery Center (Pune). Full Time. 10-15 Experience.Minimum Experience : 10 Years.We are looking for a Big Data / Cloud Architect to become part of Atgeir's Advanced Data Analytics team.The desired candidate is a Professional with proven track record of working on Big Data and Cloud Platforms.Required Skills :- Work closely...

  • Big Data

    2 weeks ago

    Pune, Maharashtra, India Atgeir Solutions Full time US$ 1,50,000 - US$ 2,00,000 per year

    We're Hiring – 𝐁𝐢𝐠 𝐃𝐚𝐭𝐚 / 𝐂𝐥𝐨𝐮𝐝 𝐀𝐫𝐜𝐡𝐢𝐭𝐞𝐜𝐭Location: 𝐆𝐥𝐨𝐛𝐚𝐥 𝐃𝐞𝐥𝐢𝐯𝐞𝐫𝐲 𝐂𝐞𝐧𝐭𝐞𝐫, 𝐏𝐮𝐧𝐞Type: 𝐅𝐮𝐥𝐥-𝐓𝐢𝐦𝐞Experience: 𝟏𝟎–𝟏𝟓 𝐘𝐞𝐚𝐫𝐬Job ID:...

  • Big Data Architect

    1 week ago

    Chennai, Tamil Nadu, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Title: Big Data ArchitectDescriptionWe are seeking a skilled Big Data Architect to design and implement scalable data processing systems. The ideal candidate will have a strong background in big data technologies and experience working with large datasets.Key Responsibilities:Liaise with cross-functional teams to understand business requirements and...

  • Data Architect

    1 week ago

    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...