Current jobs related to High-Performance Data Architect - Chennai, Tamil Nadu - beBeeDataEngineer

  • Data Architect

    1 week ago


    Chennai, Tamil Nadu, India Wavicle Data Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Job Title: Data Architect – AWS & GCP Experience: 11 Years Location: Remote / Hybrid Job Type: Full-timeAbout the Role:We are seeking an experienced Data Architect with deep expertise in AWS and Google Cloud Platform (GCP). The ideal candidate will have a proven track record in designing and implementing scalable, secure, and high-performance data...


  • Chennai, Tamil Nadu, India beBeeData Full time ₹ 40,00,000 - ₹ 50,00,000

    Senior Data Engineer RoleWe are seeking a highly skilled Senior Data Engineer to join our growing team of consultants.In this role, you will be responsible for designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence. You will collaborate closely with data scientists, analysts, and...


  • Chennai, Tamil Nadu, India beBeeDataLeader Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job DescriptionWe are seeking an experienced professional to lead our high-performance data team. As a key member of our organization, you will be responsible for driving the technical vision for our real-time streaming platform that powers critical trading infrastructure.Your Role- Lead and scale a specialized data & platform engineering team of talented...


  • Chennai, Tamil Nadu, India beBeePySparkDeveloper Full time ₹ 5,00,000 - ₹ 8,00,000

    We are seeking a seasoned Data Engineer with expertise in PySpark and distributed data processing to lead our team in designing and implementing scalable data solutions.Key Responsibilities:Design, implement and maintain high-performance PySpark data pipelines on cloud-based platforms like AWS EMR or Databricks.Integrate and synchronize data between...


  • Chennai, Tamil Nadu, India beBeeDataScience Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Senior Data Engineering PositionWe are seeking an experienced Senior Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and implementing scalable systems, developing real-time data engineering pipelines, and building high-performance applications.You will architect and build petabyte-scale...


  • Chennai, Tamil Nadu, India beBeeArchitectural Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Architectural Leader - US HealthcareDrive architectural strategy aligned to business goals and US healthcare regulations.Lead a high-performance architecture team, inspiring growth and professional development.Partner with cross-functional teams for alignment and delivery excellence.Provide end-to-end architectural guidance for complex initiatives.Define...


  • Chennai, Tamil Nadu, India NTT DATA Full time US$ 1,50,000 - US$ 2,00,000 per year

    NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Salesforce Technical Architect to join our team in Noida\Bengaluru\Chennai\Hyderabad, Karnataka, India. Job Summary: We are seeking...


  • Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 30,00,000 - ₹ 42,00,000

    Key Data Engineer RoleWe are seeking a highly skilled data engineer to join our professional services team. As a key member of our engineering team, you will design, build, and maintain high-performance data pipelines that process large volumes of data.This role is critical in ensuring our data infrastructure can handle increasing volumes of data while...


  • Chennai, Tamil Nadu, India beBeeFpga Full time US$ 1,20,000 - US$ 1,50,000

    FPGA ArchitectThe FPGA Architect will play a pivotal role in crafting high-performance FPGA designs for wireless communication and aerospace systems.


  • Chennai, Tamil Nadu, India beBeeDataEngineering Full time ₹ 1,72,10,000 - ₹ 2,54,15,000

    Senior Data Engineering Leader Talent500 seeks a visionary Senior Lead Data Engineer to join their Enterprise Data & Analytics team.This role involves leading the design and implementation of scalable, high-performance data solutions that support various business functions across a world-class manufacturing organization.The successful candidate will drive...

High-Performance Data Architect

2 weeks ago


Chennai, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,79,88,030 - ₹ 2,59,11,620
Job Overview

We are re-thinking our approach to delivering data solutions and planning for a phased transition to more efficient and effective data management practices. Our goal is to find a skilled Data Engineer who can help us meet these evolving data needs.

Main Responsibilities
  • Design and implement data flows for big data/data lake use cases, ensuring scalability and efficiency.
  • Develop a comprehensive understanding of full life cycle of data management principles, including Data Governance, Architecture, Modelling, Storage, Security, Master data, and Quality.
  • Collaborate with analytics and business stakeholders to improve data models that feed BI tools, increasing data accessibility, and fostering data-driven decision making across the organization.
  • Work with team of data engineers to deliver tasks and achieving weekly and monthly goals, also guiding the team to follow best practices and improve deliverables.
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability.
  • Responsible for estimating the cluster size, core size, monitoring, and troubleshooting of the data bricks cluster and analysis server to produce optimal capacity for computing data ingestion.
  • Deliver master data cleansing and improvement efforts; including automated and cost-effective solutions for processing, cleansing, and verifying the integrity of data used for analysis.
  • Expertise in securing the big data environment including encryption, tunnelling, access control, secure isolation.
  • To guide and build highly efficient OLAP cubes using data modelling techniques to cater all the required business cases and mitigate the limitation of Power BI in analysis service.
  • Deploy and maintain highly efficient CI/CD devops pipelines across multiple environments such as dev, stg and production.
  • Strictly follow scrum based agile approach of development to work based on allocated stories.
  • Comprehensive knowledge on data extraction, Transformation and loading data from various sources like Oracle, Hadoop HDFS, Flat files, JSON, Avro, Parquet and ORC.
  • Experience defining, implementing, and maintaining a global data platform.
  • Experience building robust and impactful data visualisation solutions and gaining adoption.
  • Extensive work experience onboarding various data sources using real-time, batch load or scheduled loads. The sources can be in cloud, on premise, SQL DB, NO SQL DB or API-based.
  • Expertise in extracting the data through JSON, ODATA, REST API, WEBSERVICES, XML.
  • Expertise in data ingestion platforms such as Apache Sqoop, Apache Flume, Amazon kinesis, Fluent, Logstash etc.
  • Hands on experience in using Databricks, Pig, SCALA, HIVE, Azure Data Factory, Python, R.
  • Operational experience with Big Data Technologies and Engines including Presto, Spark, Hive and Hadoop Environments.
  • Experience in various databases including Azure SQL DB, Oracle, MySQL, Cosmos DB, MongoDB.
Desirable Qualifications & Skills
  • Bachelor's degree (masters' preferred) in Computer Science, Engineering, or any other technology related field.
  • 10+ years of experience in data analytics platform and hands-on experience on ETL and ELT transformations with strong SQL programming knowledge.
  • 5+ years of hands-on experience on big data engineering, distributed storage and processing massive data into data lake using Scala or Python.
  • Proficient knowledge on Hadoop and Spark eco systems like HDFS, Hive, Sqoop, Oozie, Spark core, streaming.
  • Experience with programming languages such as Scala, Java, Python and Shell scripting.
  • Proven Experience in pulling data through REST API, ODATA, XML,Web services.
  • Experience with Azure product offerings and data platform.
  • Experience in data modelling (data marts, snowflake/Star, Normalization, SCD2).
  • Architect and defining the data flows and building highly efficient, scalable data pipelines.
  • To work in tandem with the Enterprise and Domain Architects to understand the business goals and vision, and to contribute to the Enterprise Roadmaps.
  • Strong troubleshooting skills, problem solving skills of any issues stopping business progress.
  • Coordinate with multiple business stake holders to understand the requirement and deliver.
  • Conducting a continuous audit of data management system performance, refine whenever required, and report immediately any breach or loopholes to the stakeholders.
  • Allocate task to various team members, track the status and provide the report on activities to management.
  • Understand the physical and logic plan of execution and optimize the performance of data pipelines.
  • Extensive background in data mining and statistical analysis.
  • Able to understand various data structures and common methods in data transformation.
  • Ability to work with ETL tools with strong knowledge on ETL concepts.
  • Strong focus on delivering outcomes.
  • Data management: modelling, normalization, cleaning, and maintenance.
  • Understand Data architectures, Data warehousing principles and be able to participate in the design and development of conventional data warehouse solutions.