Lead Big Data Architect

1 day ago

Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Job Description:

We are seeking a highly skilled Data Engineer to join our team of consultants.

In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.

You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our Databricks solution.

Key Responsibilities:

  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
  • Mentor and guide junior data engineers, providing technical leadership and support.
  • Stay current with emerging technologies and trends in data engineering, and apply them to improve existing systems.

Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems
  • 3+ years of experience with Databricks
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment

About Us:

We are an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

  • Big Data Expert

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Senior Big Data EngineerWe are seeking a talented Senior Big Data Engineer to join our Professional Services team. As a key member of our engineering group, you will play a critical role in designing, building, and maintaining high-performance data pipelines that process massive amounts of data.This is an exciting opportunity to leverage your expertise in...

  • Big Data Engineer

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Job TitleWe are seeking a skilled Big Data Engineer to join our team.The successful candidate will have hands-on experience with Pyspark and Python programming languages, as well as expertise in Big Data technologies. They should also be proficient in AWS services, including Amazon EMR, Amazon Athena, AWS Glue, Amazon Lambda, Amazon EC2, S3, and...

  • Big Data Engineering Expert

    1 day ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,10,000

    Job Title:">Senior Data Engineer">This is a highly sought-after role for professionals with a strong background in big data engineering and analytics. As a senior data engineer, you will be responsible for designing, developing, and implementing large-scale data processing systems that drive business insights.">Required Skills and Qualifications:">5+ years...

  • Distributed Data Systems Architect

    1 day ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time US$ 80,000 - US$ 1,20,000

    Job Title: Distributed Data Systems ArchitectThis role involves building scalable data pipelines, working with real-time streaming data, and collaborating with cross-functional teams to deliver high-quality solutions.About the RoleWe are seeking a seasoned Data Engineer to design, build, and maintain large-scale distributed data systems. The ideal candidate...

  • Chief Data Architect

    1 day ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data Engineers at our organization design, build and maintain large-scale data systems. They work closely with cross-functional teams to ensure the highest standards of data quality and performance.The role requires expertise in data engineering, data architecture, pipeline creation and big data technologies. Responsibilities include:Designing, developing...

  • Data Engineer Team Lead

    1 day ago

    Vadodara, Gujarat, India beBeebigdataengineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Cloud Data Engineering Leadership OpportunityWe are seeking an experienced Engineering Manager to lead our team of data engineers in designing and delivering scalable data pipelines and analytics platforms. With a strong background in Big Data ecosystems and Microsoft Azure, you will drive business growth through innovative solutions.

  • Chief Data Architect

    1 day ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    Experienced professionals are sought after to lead data architecture initiatives.This is a unique opportunity to leverage technical expertise in Databricks and drive business impact through scalable data platforms and AI solutions.Key Responsibilities:1. Design and implement secure, efficient, and scalable Databricks solutions that meet client...

  • Chief Data Architect

    3 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Summary">We're seeking a highly skilled Data Architect to join our team. In this role, you will be responsible for designing and implementing data warehouse solutions that meet business needs.The ideal candidate will have strong experience with SQL Servers and relational databases, as well as expertise in data visualization and reporting tools such as...

  • Data Innovator

    5 days ago

    Vadodara, Gujarat, India beBeeData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    About Data Architect RoleA leading organization is seeking an experienced Data Architect to drive the development of data-driven solutions on Google Cloud Platform (GCP). Key Responsibilities:

  • Chief Data Architect

    5 days ago

    Vadodara, Gujarat, India beBeeDataEngineer Full time ₹ 80,00,000 - ₹ 1,20,00,000

    Job DescriptionAre you passionate about working with data and driving business outcomes?We're seeking a talented Data Engineer to join our team, responsible for designing, building, and maintaining large-scale data systems.As a Data Engineer, you will play a key role in shaping our company's data strategy, collaborating closely with cross-functional teams to...