ETL Developer

4 weeks ago

Visakhapatnam, India Xped pvt Ltd Full time

Job Responsibilities :

- Development and optimization of scalable data pipelines for efficient extraction, transformation, and loading (ETL) of data from diverse sources, leveraging technologies like Spark, Dask, and other modern ETL frameworks.

- Develop and implement data quality controls, including monitoring and remediation processes

- Provide technical guidance and mentorship to junior ETL developers

- Collaborate with the infrastructure team to ensure the availability, reliability, and scalability of ETL solutions

- Participate in code reviews and contribute to the development of coding standards and best practices

- Stay up-to-date with emerging trends and technologies in ETL development and data management

- Architect and implement advanced data models for both NoSQL (e.g., HBase) and relational databases, ensuring high performance, scalability, and cost efficiency in data storage and retrieval processes.

- Establish robust systems to ensure data quality, implementing monitoring tools and validation frameworks to guarantee accuracy and availability of production data for key business stakeholders.

- Design, build, and maintain high-performance APIs to provide seamless access to curated data sets for both internal teams and external clients.

- Oversee the assembly of large, complex data sets that meet functional, non-functional, and business requirements, enabling data-driven decision-making across the organization.

- Conduct root cause analysis on internal and external data and processes to resolve business inquiries, support client requests, and proactively identify areas for system and process improvement.

- Collaborate closely with cross-functional teams, providing leadership and technical guidance to ensure alignment on data architecture and delivery goals.

Technical Requirements :

- 2+ years of experience in developing, testing, and maintaining applications using Python, Bash, and SQL, with a focus on delivering scalable solutions.

- Strong expertise in writing clean, efficient, and maintainable code, with a deep understanding of design patterns and best practices.

- In-depth knowledge of SQL and NoSQL databases, including database design and optimization techniques.

- Extensive experience with parallel processing and distributed computing frameworks like Hadoop, Spark, or Dask.

- Proven track record in custom ETL design, implementation, and operational maintenance in complex environments.

- Familiarity with ETL orchestration frameworks such as Luigi, Apache Airflow, or Apache NiFi is an advantage.

- Proficiency in backend frameworks like Django or Flask, with demonstrated experience in building and maintaining web services and APIs.

- Strong experience with cloud platforms (AWS, GCP, Microsoft Azure), including cloud-based data storage and processing solutions.

- Exposure to data analytics, data science, or machine learning workflows is a plus.

(ref:hirist.tech)

  • SQL Developer

    3 weeks ago

    Visakhapatnam, India TechnoRight Full time

    Job Description :Job Responsibilities :- Design, develop, and maintain efficient database solutions using SQL Server, SSIS (SQL Server Integration Services), or other ETL tools.- Create and manage ETL processes to extract, transform, and load data from multiple sources into databases or data warehouses.- Develop stored procedures, views, functions, and...

  • Miracle Software Systems

    2 weeks ago

    Visakhapatnam, India Miracle Software Systems Full time

    Position : IDMC DevelopersDuration : Full TimeEXp : 6+ yearsLocation : vishakhapatnamPrimary skills : IDMCJob Description :We are seeking an experienced Informatica Intelligent Data Management Cloud (IDMC) Developer to design, develop, and implement cloud-based data integration and management solutions. The role will focus on building robust ETL/ELT...

  • Miracle Software Systems

    5 days ago

    Visakhapatnam, India Miracle Software Systems Inc Full time

    Description : Looking for IDMC Developer position for Miracle Software Systems Inc, at Vizag location.Position : IDMC Developer.Location : Visakhapatnam.Duration : Permanent.Experience : 4+ Years.About the Role :We are seeking an experienced Informatica Intelligent Data Management Cloud (IDMC) Developer to design, develop, and implement cloud-based data...

  • Power BI Developer

    4 weeks ago

    Visakhapatnam, India TechnoRight Full time

    Role Area : Power Bi DeveloperJob Description : - Design implementing and develop reporting and analytics solutions. - In-depth understanding of database management systems, online analytical processing (OLAP) and ETL framework. - Strong understanding of the Microsoft technology stack (SQL Server, SQL Server Integration Services, Analysis Services, Tabular...

  • Senior Data Engineer

    1 week ago

    Visakhapatnam, India Miracle Software Systems Full time

    The desired candidate should have over 5 years of experience with a strong emphasis on Snowflake and Matillion ETL Should have experience in troubleshooting and resolving issues related to Matillion ETL processes, ensuring data quality and integrity Experience in traditional RDBMS on both SQL, PL/SQL along with Data warehousing concepts Strong background in...

  • Big Data with Quantexa-Pan India

    2 weeks ago

    Visakhapatnam, India Tata Consultancy Services Full time

    Dear Candidates,Greetings from TCS TAG team,We are looking for Big data developer with Quantexa as mandatory skill.Location-Pan IndiaExperience Range- 5 to 12 yearsData Engineer - Big Data Hadoop, Spark and ScalaSpark, Scala, Hadoop, HIVE, Oozie, Shell Script, Quantexa(Mandatory)Please hit apply button and fill details for the job application.Desired...

  • Data Engineer – Microsoft Fabric

    3 weeks ago

    Visakhapatnam, India jasp information solutions Full time

    Data Engineer – Microsoft Fabric Experience: 4 to 6 years with at least 1 year with Microsoft Fabric Role: The data engineer will design, develop, and optimize data pipelines, reporting solutions, and analytics frameworks using Microsoft Fabric. You will collaborate with stakeholders and technical teams to deliver scalable, secure, and high-performing...

  • Data Owner

    3 weeks ago

    Visakhapatnam, India Apexsync Technologies Full time

    Hello Everyone,Title: Data OwnerLocation: Remote (Anywhere in India)Type: ContractClient: Soften CityRole & Scope: Own and oversee the Data & Analytics pillar of the FinCrime Platform; active member of the FinCrime Steering Committee (SteerCo).Key Focus: Develop and implement data strategy, ensure governance, quality, reporting, and drive insights for...

  • Sap bw consultant

    2 weeks ago

    Visakhapatnam, India HTC Global Services Full time

    Exciting Opportunity Alert! ???? HTC Global Services is hiring SAP BW Consultant for our premium project.HTC Global Services - a leading CMM level 5 global provider of innovative IT and Business Process Services and Solutions since 1990 with headquarters in Troy, Michigan, USA.SAP BW Consultant Experience: 8-10 YearsBachelor degree with at least 10 years of...

  • Data Analyst

    1 week ago

    Visakhapatnam, India Cozzera Full time

    Job Title: Healthcare Data Analyst (Offshore/Onshore)Location: Remote (1–2 days onsite per month, any location)Work Hours: 11:00 AM – 9:00 PMExperience Required: 5+ Years (Healthcare Domain Must)Employment Type: Full-timeAbout the Role:We are seeking an experienced Healthcare Data Analyst with a strong background in healthcare data systems, modeling, and...