Data Pipelines Architect

3 days ago

Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 15,00,000 - ₹ 25,00,000
Data Engineering Professional

We are seeking a highly skilled Data Engineer to fill this critical role. The successful candidate will be responsible for designing, building, and optimizing complex data pipelines in large enterprise environments.

Key Responsibilities:

  • Data Pipeline Development: Design, build, and optimize data pipelines to ensure efficient data flow and processing.
  • Big Data Technologies: Utilize Apache Spark (using Scala or PySpark) to process and analyze large datasets, ensuring high performance and scalability.
  • Programming: Leverage Python for data manipulation, scripting, and automation tasks. Experience with Scala is highly desirable for enhancing data processing capabilities.
  • Data Processing & Wrangling: Cleanse, transform, and aggregate large datasets from various sources, ensuring data quality and integrity.
  • Database Skills: Demonstrate solid understanding and experience with SQL for querying and optimization, along with familiarity with NoSQL concepts and databases.
  • Agile/Scrum Experience: Collaborate effectively within an Agile/Scrum team, engaging directly with clients or business stakeholders to gather requirements and deliver solutions.
  • Communication & Collaboration: Exhibit excellent verbal and written communication skills, capable of explaining complex technical concepts to diverse audiences and working effectively in a team environment.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Proven experience as a Data Engineer or in a similar role, with a strong focus on data pipeline development and big data technologies.
  • Proficiency in Apache Spark (Scala or PySpark) and Python for data manipulation and automation.
  • Solid experience with SQL, including querying and optimization techniques.
  • Familiarity with NoSQL databases and concepts.
  • Experience working in Agile/Scrum teams, with a collaborative approach to problem-solving.
  • Strong analytical skills and attention to detail.

Preferred Qualifications:

  • Experience with cloud platforms (e.g., AWS, Azure, Google Cloud) for data processing and storage.
  • Knowledge of data warehousing concepts and tools.
  • Familiarity with data visualization tools (e.g., Tableau, Power BI) is a plus.

  • Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeETLDeveloper Full time ₹ 1,20,00,000 - ₹ 1,50,00,000

    About the RoleWe are seeking a skilled Senior ETL Developer to join our team.The successful candidate will be responsible for evaluating and understanding current-state Informatica ETL jobs, mappings, workflows, and dependencies.Key responsibilities include:Evaluating and redesigning data pipelines using Databricks (PySpark/Scala/SQL) to optimize performance...

  • Data Pipeline Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job TitleData Engineering ManagerRole OverviewThe Senior Data Engineer will design, develop, and maintain scalable data pipelines and infrastructure to support data-driven decision-making and advanced analytics. They must have deep expertise in data engineering, strong problem-solving skills, and the ability to collaborate with cross-functional teams to...

  • Strategic Data Pipeline Architect

    4 days ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 19,96,000 - ₹ 24,64,700

    Job DescriptionWe are seeking a highly skilled Data Engineer to design, develop, and maintain data pipelines that extract data from Oracle Symphony via APIs, process and store it in the Databricks Lakehouse platform, and then integrate it into Oracle EPM (Enterprise Performance Management).This role requires deep expertise in data integration, ETL/ELT, APIs,...

  • Chief Data Pipeline Architect

    17 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Senior Data Engineering LeadWe are seeking an experienced Senior Data Engineering Lead to join our team. In this role, you will lead and mentor data engineering teams to ensure alignment with technical and business objectives.You will be responsible for architecting, designing, and implementing scalable and high-performance data pipelines that meet the needs...

  • Senior Data Pipeline Architect

    2 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewAs a senior data pipeline architect, you will be responsible for designing, developing, and deploying scalable data architectures using big data technologies.You will collaborate with stakeholders to understand data requirements and translate them into technical solutions. Your expertise in writing complex SQL queries and knowledge of advanced...

  • Data Architect

    14 hours ago

    Bengaluru, Karnataka, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Data EngineerWe are seeking a skilled Data Engineer to build, optimize, and maintain data pipelines and architectures.Key Responsibilities:Design, develop, and optimize scalable data pipelines and workflows using Azure Data Factory, Synapse Pipelines, and Microsoft Fabric.Transform and migrate existing Alteryx workflows into scalable Azure Databricks...

  • Senior Data Pipeline Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeDataLeader Full time ₹ 1,04,000 - ₹ 1,30,878

    Job DescriptionAs a seasoned data professional, you will be responsible for leading cross-functional teams in the development and maintenance of large-scale data pipelines. Your expertise will be essential in architecting and implementing scalable data solutions that drive business growth.Required Skills and QualificationsMinimum 5 years of experience...

  • Senior Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeDataEngineering Full time ₹ 1,04,000 - ₹ 1,30,878

    Lead Data EngineeringThe Lead Data Engineer is a key member of our engineering team, responsible for leading and mentoring data engineers to ensure alignment with technical and business objectives.As a senior data engineer, you will architect, design, and implement scalable and high-performance data pipelines using AWS technologies. You will collaborate with...

  • Chief Data Pipeline Architect

    7 days ago

    Bengaluru, Karnataka, India beBeeData Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job Title:High-Performance Data Solutions Architect">">">Design and develop scalable, high-availability data pipelines for large-scale data sets.">Collaborate with cross-functional teams to understand business requirements and drive technology solutions.">Implement automation and DevOps practices to improve efficiency and reduce team effort.">Lead technical...

  • Data Pipeline Architect

    1 week ago

    Bengaluru, Karnataka, India beBeeAzure Full time ₹ 15,00,000 - ₹ 25,00,000

    Freelance Azure Data Factory SpecialistWe are seeking an experienced Freelance Azure Data Factory (ADF) Specialist to support our data integration and ETL needs.The ideal consultant will have strong hands-on expertise in Azure ADF pipelines, data orchestration, and transformations to ensure smooth, scalable, and secure data flows across multiple sources and...