Data Engineering Specialist

4 days ago

Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 80,00,000 - ₹ 1,20,00,000
Job Title

Data Engineering Specialist

  • Job Description:
  • Data Ingestion and Pipelines: Design, develop, and maintain ETL/ELT data pipelines to ingest data from various sources into our data warehouse.
  • AWS Services: Utilize AWS services such as AWS Lambda, AWS DMS, and AWS Glue for data ingestion and transformation processes.
  • Snowflake Stored Procedures: Develop and optimize Snowflake stored procedures to implement complex business logic and data transformations.
  • Apache Airflow: Manage and monitor scheduled data workflows using Apache Airflow.
  • Stakeholder Collaboration: Work closely with stakeholders to understand project requirements and translate them into technical solutions, ensuring seamless integration with existing data pipelines.
  • Quality Assurance: Implement and maintain robust data quality checks to ensure accuracy and reliability of all delivered datasets and reports.
  • Project Delivery Lifecycle: Adhere to the full project delivery lifecycle, including requirements gathering, design, implementation, documentation, and obtaining user acceptance testing (UAT) approvals.
  • Data Delivery: Deliver data sets to other AWS accounts and support the creation of Power BI reports.

Required Skills and Qualifications

  • Proven Experience: Proven experience as a Data Engineer or in a similar role.
  • SQL Scripting: Strong proficiency in SQL scripting.
  • Python Skills: Proficiency in Python for data manipulation and automation.
  • Apache Airflow: Experience with Apache Airflow for workflow orchestration.
  • Hands-on Experience: Hands-on experience with AWS Cloud services, including Lambda, DMS, and Glue.
  • Snowflake Understanding: Solid understanding of data warehousing concepts, with practical experience using Snowflake.
  • Problem-Solving Skills: Excellent problem-solving skills and the ability to design and implement solutions based on business requirements.
  • Software Development Lifecycle: Experience with the full software development lifecycle (SDLC) and project documentation.
  • Data Quality Best Practices: Familiarity with data quality best practices.
  • Communication Skills: Strong communication and collaboration skills.

Benefits

  • Opportunity to work with advanced technologies
  • Collaborative team environment
  • Professional growth and development

Others

  • We are an equal opportunity employer
  • We value diversity and inclusion

  • SAP Developer

    3 days ago

    Coimbatore, Tamil Nadu, India beBeeABAP Specialist Full time ₹ 80,00,000 - ₹ 1,50,00,000

    ">SAP ABAP Consultant","We are seeking a seasoned SAP ABAP consultant with expertise in Master Data Management (MDM) and integration skills to join our team. This role requires a highly motivated professional who can design, develop, and support scalable SAP solutions while collaborating with global teams."",

  • Senior Data Engineering Specialist

    1 day ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineering Full time ₹ 2,00,00,000 - ₹ 2,50,00,000

    Job SummaryWe are seeking an experienced Data Engineering Specialist to join our team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems.About the RoleThis is a challenging opportunity for a skilled data engineer with experience in ETL (Extract, Transform, Load) processes, PySpark, Python,...

  • Cloud Data Specialist

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeData Full time ₹ 18,00,000 - ₹ 25,00,000

    Job Title: Cloud Data SpecialistWe are seeking a skilled Cloud Data Specialist to join our team. This is an exciting opportunity to work with cutting-edge technology and contribute to the development of innovative data solutions.As a Cloud Data Specialist, you will be responsible for designing and implementing data pipelines that clean, transform, and...

  • Data Pipeline Specialist

    1 day ago

    Coimbatore, Tamil Nadu, India beBeeDataPipeline Full time ₹ 30,00,000 - ₹ 40,00,000

    Key Data Pipeline SpecialistThe role entails designing, developing, and maintaining high-capacity data pipelines that efficiently handle structured and unstructured data.ResponsibilitiesDesign and Build Complex Pipelines: You will be responsible for designing and building complex production-level data pipelines utilizing AWS services such as S3, EC2, RDS,...

  • Data Engineering Specialist

    1 day ago

    Coimbatore, Tamil Nadu, India beBeeDataEngineer Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Data Engineer RoleWe are seeking an experienced Data Engineer to join our team of experts in designing, developing, and maintaining large-scale data pipelines.The ideal candidate will have a strong background in big data technologies, including Hadoop, Spark, Hive, and Kafka. They will also possess excellent SQL skills, with the ability to write and optimize...

  • Data Governance Specialist

    4 days ago

    Coimbatore, Tamil Nadu, India beBeeDataGovernance Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Data Catalog SpecialistWe are seeking an experienced data catalog specialist to join our team. This role will be responsible for ensuring the accuracy and integrity of our data assets, while also providing expertise on metadata management and data governance principles.Key Responsibilities:Metadata IngestionData Lineage StitchingWorkflow...

  • Data Annotation Specialist

    1 week ago

    Coimbatore, Tamil Nadu, India beBeeAnnotation Full time ₹ 4,00,000 - ₹ 7,50,000

    Job Title: Data Annotation SpecialistJob Type: Contract, 100% remote.The role requires a meticulous and organized individual to accurately annotate and label data across various formats (text, image, video, or audio) in accordance with project guidelines.A significant portion of the job involves reviewing and validating existing annotations for consistency...

  • Systems Integration Specialist

    4 weeks ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    Req ID 307839NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a Systems Integration Specialist to join our team in Coimbatore Tamil Nxc4x81du IN-TN India IN NLG Vantage Senior...

  • Data Engineering Specialist

    22 hours ago

    Coimbatore, Tamil Nadu, India beBeeSoftware Full time ₹ 15,00,000 - ₹ 25,00,000

    Python Developer PositionWe are seeking an experienced software engineer to join our team at Kadinnova Technologies Pvt. Ltd.Main Responsibilities:Design and implement automated data pipelines using Google Cloud PlatformDevelop analytical algorithms to drive business insightsCreate REST APIs to facilitate data exchangeWork with various databases, including...

  • MC -Mechanical Engineer

    16 hours ago

    Coimbatore, Tamil Nadu, India Capgemini Engineering Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    At Capgemini Engineering, the world leader in engineering services, we bring together a global team of engineers, scientists, and architects to help the world's most innovative companies unleash their potential. From autonomous cars to life-saving robots, our digital and software technology experts think outside the box as they provide unique R&D and...