Unlocking the Power of Data: A Senior Data Engineer Role

5 days ago

Hyderabad Secunderabad Telangana Delhi, India beBeeDataEngineering Full time ₹ 8,00,000 - ₹ 12,00,000
Senior Data Engineering Specialist

We are seeking an experienced Senior Data Engineering Specialist to join our team.

About the Role

This is a challenging and rewarding role that involves designing, developing, and maintaining large-scale data systems. The successful candidate will have strong technical skills in data engineering, including experience with data warehousing concepts, ETL processes, and data modeling. They will also have excellent problem-solving, analytical, and critical thinking skills, as well as strong communication and collaboration skills.

Key Responsibilities
  1. Design and develop data pipelines for Generative AI projects using Vector DB, Graph DB, Airflow, Spark, PySpark, Python, langchain, AWS Functions, Redshift, and SSIS.
  2. Manage movement, organization, and quality assessments of large sets of data to facilitate the creation of Knowledge bases for RAG systems and model training.
  3. Demonstrate familiarity with data integration services such as AWS Glue and Azure Data Factory, showcasing the ability to effectively utilize these platforms for seamless data ingestion, transformation, and orchestration across various sources and destinations.
  4. Possess proficiency in constructing data warehouses and data lakes, demonstrating a strong foundation in organizing and consolidating large volumes of structured and unstructured data for efficient storage, retrieval, and analysis.
  5. Optimize and maintain data pipelines to ensure high-performance, reliable, and scalable data processing.
  6. Develop and implement data validation and quality assurance procedures to ensure the accuracy and consistency of the data used in Generative AI projects.
  7. Monitor and troubleshoot data pipeline performance, identify bottlenecks, and implement improvements as necessary.
Requirements
  • Bachelor's or Master's degree in Computer Science, Engineering, or a related field.
  • Strong experience with data engineering technologies, including Vector DB, Graph DB, Airflow, Spark, PySpark, Python, langchain, AWS Functions, Redshift, and SSIS.
  • Strong understanding of data warehousing concepts, ETL processes, and data modeling.
  • Familiarity with Generative AI concepts and technologies, such as GPT-4, Transformers, and other natural language processing techniques.
  • Excellent problem-solving, analytical, and critical thinking skills.
  • Strong communication and collaboration skills, with the ability to work effectively with cross-functional teams.
Preferred Qualifications/ Skills
  • Knowledge of cloud computing platforms, such as AWS, Azure, or Google Cloud Platform.
  • Experience with big data technologies, such as Hadoop, Hive, or Presto.
  • Familiarity with machine learning frameworks, such as TensorFlow or PyTorch.

  • Data Engineer Senior Consultant

    1 day ago

    Hyderabad, Telangana, India NTT Data Full time

    Job DescriptionReq ID:330296NTT DATA strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer Senior Consultant to join our team in Hyderabad, Telangana (IN-TG), India (IN).- Understand...

  • Data Scientist

    5 days ago

    Hyderabad, Telangana, India NTT DATA Full time

    Job Responsibilities: - Enable team to run an automated design engine - Creates design standards and assurance processes for easily deployable and scalable models. - Ensure successful developments: Be a technical leader through strong example and training of more junior engineers, documenting all relevant product and design information to educate others on...

  • Senior Associate Data Engineer

    4 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    Job Description:We are seeking a talented Senior Associate Data Engineer to join our team. As a key member of our data engineering group, you will be responsible for designing and developing advanced data visualization solutions that support global medical teams.Key Responsibilities:Develop interactive dashboards and reports using Tableau and Power BIBuild...

  • Senior Data Engineer Role

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineering Full time

    As a Data Engineering Specialist, you will play a pivotal role in shaping our data engineering strategies.Must-Have Skills:Hands-on experience with cutting-edge technologies like Databricks, PySpark, SparkSQL, Apache Spark, AWS, Python, SQL, and Scaled Agile methodologies.Expertise in workflow orchestration, performance tuning on big data processing.Deep...

  • Senior Data Engineer

    2 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time ₹ 1,04,000 - ₹ 1,30,878

    About the RoleThis is a senior data engineering position focused on utilizing business acumen to work with stakeholders and other data engineers to define, design, and implement data solutions that support the organization s data initiatives. The ideal candidate will have experience in designing and building pipelines using cloud technology for extracting,...

  • Azure Data Engineer

    7 days ago

    Hyderabad, Telangana, India Enable Data Incorporated Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Enable Data Incorporated is currently seeking a skilled and experienced Azure Data Engineer to join our dynamic team. As a leading provider of advanced application, data, and cloud engineering services, Enable Data has developed deep expertise across various industries. We work closely with our customers to leverage modern solutions and technologies to drive...

  • Senior Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Job Title: Senior Data EngineerKey Responsibilities:We are seeking a highly skilled and experienced Senior Data Engineer to lead the design, development, and implementation of large-scale data pipelines using Python, Pyspark, and SQL. The ideal candidate will have strong technical expertise in data engineering concepts, with the ability to handle multiple...

  • Unlocking Career Opportunities in Data

    11 hours ago

    Hyderabad, Telangana, India beBeeDataEngineering Full time US$ 1,00,000 - US$ 1,50,000

    Unlocking the Power of Data EngineeringTransforming lives through innovative data solutions is a challenging yet rewarding career goal. As a key member of our team, you will play a vital role in developing cutting-edge analytics solutions that accelerate discovery and bring life-changing treatments to patients.Key Responsibilities:Design and build scalable...

  • Chief Data Architect

    4 hours ago

    Hyderabad / Secunderabad, Telangana, India beBeeDataEngineer Full time US$ 1,04,000 - US$ 1,30,878

    Unlock Business Value as a Data EngineerYou will be responsible for end-to-end development of enterprise analytics and data mastering solutions using Databricks and Power BI. This vital role requires expertise in data architecture and analytics to create scalable, reliable, and impactful solutions that support research cohort-building and advanced research...

  • Data Engineer

    4 days ago

    Hyderabad / Secunderabad, Telangana, India beBeeData Full time

    Senior Data EngineerWe are seeking a seasoned Senior Data Engineer to join our team. This role involves designing, implementing and maintaining large-scale data processing systems.Job Description:Develop and maintain high-quality, scalable data pipelines using Informatica, SQL and Unix.Design and implement efficient data warehousing solutions for complex...