Principal Big Data Architect

2 weeks ago

Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 20,00,000
Senior Data Engineer Job Description

We seek a highly skilled and experienced Senior Data Engineer to join our team of consultants. In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.

You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our Databricks solution.

The ideal candidate will have a strong understanding of data warehousing concepts, data modeling, and schema design. They will also possess excellent problem-solving skills and attention to detail, as well as strong communication skills and the ability to work effectively in a team-oriented environment.

Key Responsibilities
  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
  • Mentor and guide junior data engineers, providing technical leadership and support.
Requirements
  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
Benefits
  • Remote work.
  • Employment/Contract Type: Contract.
  • Location: India.
  • Duration: 1 year (with potential to be extended).
  • Hours per Week: 40 (Full-time).
About Us

We are an Equal Opportunity Employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

  • Senior Big Data Architect Position

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeArchitecture Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data ArchitectJob Description:We are seeking a highly skilled Big Data Architect to join our team. The ideal candidate will have extensive experience in designing and implementing large-scale data processing systems.Required Skills and Qualifications:Hands-on experience with AWS, Python, and PySpark5+ years of overall IT experience, including...

  • Senior Big Data Solutions Architect

    7 days ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Title: Senior Big Data Solutions ArchitectWe are seeking a highly skilled and experienced Senior Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing, developing, and maintaining large-scale data architectures and solutions.About the Role:The ideal candidate will have a strong...

  • Big Data Architect

    7 days ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Big Data EngineerWe are seeking a skilled Big Data Engineer to design, execute, and manage large-scale distributed data systems.Experience in big data technologies (Apache Hadoop)Relational databases (MS SQL Server/Oracle/MySQL/PostgreSQL)Proficiency in at least one of the following programming languages - Java, Python or ScalaSQL...

  • Senior Big Data Architect

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeBigData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking a highly skilled and experienced professional to lead the development of a cutting-edge big data platform. This individual will be responsible for building a scalable and extensible system that provides the foundation for collecting, storing, modeling, and analyzing massive data sets from multiple channels.Key...

  • Big Data Specialist

    1 week ago

    Ellore, Andhra Pradesh, India beBeeDataEngineering Full time ₹ 1,50,00,000 - ₹ 2,25,00,000

    Job Overview:Data architects at top organizations design and develop large-scale data pipelines for ingestion, transformation, and storage. They work with Big Data ecosystems such as Hadoop, Spark, Hive, and similar technologies to process structured and unstructured data.ResponsibilitiesDevelop efficient ETL processes to integrate data from multiple sources...

  • Data Architect

    5 days ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title: Data ArchitectAs a senior data architect, you will play a key role in designing and implementing data architectures that drive business value. Your expertise in data modeling, data warehousing, and big data technologies will be essential in ensuring the scalability and performance of our data platforms.

  • Chief Data Transformation Officer

    5 days ago

    Ellore, Andhra Pradesh, India beBeeData Architect Full time ₹ 25,00,000 - ₹ 30,00,000

    Lead Large-Scale Data Engineering ProjectsAs a seasoned data architect, you will spearhead the development and implementation of cutting-edge data solutions. Your expertise in data integration, warehousing, and API-based integrations will be instrumental in transforming raw data sources into actionable insights.You will work closely with cross-functional...

  • Principal Big Data Engineer

    22 hours ago

    Ellore, Andhra Pradesh, India beBeeDataEngineer Full time ₹ 1,00,00,000 - ₹ 2,00,00,000

    Job OverviewAs a Data Engineer, you will be responsible for designing and implementing scalable data processing pipelines using cloud-based technologies. Your expertise in software development methodologies and ability to collaborate with cross-functional teams will play a key role in the success of our organization.Key Responsibilities:Develop data...

  • Big Data Solutions Expert

    2 weeks ago

    Ellore, Andhra Pradesh, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Senior Data ArchitectThe ideal candidate for this position will be responsible for designing and building large-scale data architectures that support business intelligence and data science initiatives. This includes architecting data warehouses, data lakes, and other data systems to enable the organization's data-driven decision-making.Key...

  • Cloud Data Architect

    17 hours ago

    Ellore, Andhra Pradesh, India beBeeDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Summary:We are seeking a skilled Cloud Data Architect to help design and deploy large-scale data engineering solutions using Python, Pyspark, and SQL. The ideal candidate will have hands-on experience with big data platforms, particularly Google Cloud Platform (GCP). Key Responsibilities:Design and develop scalable data architectures using cloud-based...