Senior Big Data Architect

24 hours ago

Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

Data Engineering Expert

We are seeking a seasoned professional with expertise in designing and implementing scalable data pipelines using cloud services and Databricks. The ideal candidate will build, optimize, and maintain high-performance workflows, manage big data environments, and ensure seamless data availability for analytics, AI/ML, and business intelligence use cases.

  • Design, develop, and maintain data pipelines and workflows utilizing AWS (S3, Redshift, Glue, EMR, Lambda, Kinesis, Athena) and Databricks.
  • Build and optimize ETL/ELT processes for large-scale structured and unstructured datasets.
  • Leverage Databricks for engineering, advanced analytics, and machine learning workloads.
  • Collaborate with scientists, analysts, and stakeholders to deliver reliable and scalable data solutions.
  • Implement governance, quality checks, and monitoring frameworks.
  • Ensure high availability, scalability, and cost-effectiveness of data solutions.

Required Skills:

  • At least 7 years of experience in data engineering.
  • Strong hands-on experience with AWS cloud services (S3, Redshift, Glue, EMR, Athena, Lambda, Kinesis).
  • Expertise in Databricks (PySpark, Delta Lake, ML pipelines).
  • Proficiency in Python and SQL for transformation and querying.
  • Strong understanding of warehousing, modeling, and big data frameworks.
  • Experience with workflow orchestration tools (Airflow, Step Functions).

PREFERRED QUALIFICATIONS:

  • Familiarity with MLOps/ML integration within Databricks.
  • Experience with real-time/streaming data (Kafka, Spark Streaming).
  • Knowledge of infrastructure as code (Terraform/CloudFormation).
  • Exposure to security, compliance, and governance practices.

  • Big Data Solutions Architect

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 9,00,000 - ₹ 12,00,000

    Job Title: Big Data Solutions Architect">About the Role:"We are seeking a highly skilled and experienced Big Data Solutions Architect to join our team. As a key member of our data engineering team, you will be responsible for designing and developing complex data solutions using Azure Data Factory, Azure Databricks, and Cosmos DB."""The ideal candidate...

  • Highly Experienced Big Data Strategist

    9 minutes ago

    Chennai, Tamil Nadu, India beBeeBigDataArchitect Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data ArchitectJob Description:We are seeking a seasoned Senior Big Data Architect to lead the design, development and deployment of industry-leading big data and AI applications. As a key member of our team, you will be responsible for providing architectural guidance that fosters the adoption of Databricks across business-facing functions.Key...

  • Pando - Senior Data Warehousing Engineer - Big Data

    4 weeks ago

    Chennai, Tamil Nadu, India Pando Corp Private Limited Full time

    About the jobSenior Data Warehouse Engineer Pando (www.pando.ai) is pioneering the future of autonomous logistics with innovative AI capabilities. Trusted by Fortune 500 enterprises with global customers across North America, Europe, and Asia Pacific regions, we are leading the global disruption of supply chain software, with our AI-powered, no-code, &...

  • Senior Big Data Engineer

    4 days ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Description\As a seasoned professional in the field of data engineering, you will play a pivotal role in designing and implementing cutting-edge data solutions that drive business growth and innovation. \Key responsibilities include architecting and defining data flows for big data/data lake use cases, with excellent knowledge on implementing full life...

  • Senior Data Architect

    59 minutes ago

    Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 12,00,000 - ₹ 20,00,000

    Key Roles and ResponsibilitiesWe are seeking a highly skilled Data Architect to lead the design, development, and optimization of large-scale data pipelines.Design, develop, and maintain ETL/ELT pipelines for structured and unstructured data.Develop and optimize big data processing jobs using PySpark.Integrate data from multiple sources into a unified data...

  • Big Data Engineering Lead- C13

    3 weeks ago

    Chennai, Tamil Nadu, India Citigroup Full time

    The Senior Big Data engineering lead will play a pivotal role in designing implementing and optimizing large-scale data processing and analytics solutions This role requires a visionary leader who can drive innovation define architecture strategy and ensure the scalability and efficiency of our big data infrastructure Key Responsibilities Lead the...

  • GCP Data Architect

    4 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Role: GCP Data ArchitectJob Location: Chennai/Hyderabad/Pune/Bangalore/GurgaonExp Range: 10Years to 15Years.Desired Competencies (Technical/Behavioral Competency):- Should have experience in GCP Data Architect- Should have experience in Data Flow, Data Proc, Big Query- Develop ETL/ELT pipeline using Data Flow, Data Proc, Big Query- Provide technical...

  • GCP Data Architect

    2 weeks ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Role: GCP Data Architect Job Location: Chennai/Hyderabad/Pune/Bangalore/Gurgaon Exp Range: 10Years to 15Years. Desired Competencies (Technical/Behavioral Competency): Should have experience in GCP Data Architect Should have experience in Data Flow, Data Proc, Big Query Develop ETL/ELT pipeline using Data Flow, Data Proc, Big Query Provide technical...

  • GCP Data Architect

    5 days ago

    Chennai, Tamil Nadu, India Tata Consultancy Services Full time

    Job Role: GCP Data ArchitectJob Location: Chennai/Hyderabad/Pune/Bangalore/GurgaonExp Range: 10Years to 15Years.Desired Competencies (Technical/Behavioral Competency):Should have experience in GCP Data ArchitectShould have experience in Data Flow, Data Proc, Big QueryDevelop ETL/ELT pipeline using Data Flow, Data Proc, Big QueryProvide technical leadership...

  • Itss-big Data/hadoop/splunk Developer-humjp00032202

    4 weeks ago

    Chennai, Tamil Nadu, India NTT DATA Full time

    Req ID 317271NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a ITSS-Big Data Hadoop Splunk Developer-HUMJP00032202 to join our team in chennai Tamil Nxc4x81du IN-TN India IN ...