ETL Developer

3 days ago

Visakhapatnam, India Xped pvt Ltd Full time

Job Responsibilities :- Development and optimization of scalable data pipelines for efficient extraction, transformation, and loading (ETL) of data from diverse sources, leveraging technologies like Spark, Dask, and other modern ETL frameworks.- Develop and implement data quality controls, including monitoring and remediation processes- Provide technical guidance and mentorship to junior ETL developers- Collaborate with the infrastructure team to ensure the availability, reliability, and scalability of ETL solutions- Participate in code reviews and contribute to the development of coding standards and best practices- Stay up-to-date with emerging trends and technologies in ETL development and data management- Architect and implement advanced data models for both NoSQL (e.g., HBase) and relational databases, ensuring high performance, scalability, and cost efficiency in data storage and retrieval processes.- Establish robust systems to ensure data quality, implementing monitoring tools and validation frameworks to guarantee accuracy and availability of production data for key business stakeholders.- Design, build, and maintain high-performance APIs to provide seamless access to curated data sets for both internal teams and external clients.- Oversee the assembly of large, complex data sets that meet functional, non-functional, and business requirements, enabling data-driven decision-making across the organization.- Conduct root cause analysis on internal and external data and processes to resolve business inquiries, support client requests, and proactively identify areas for system and process improvement.- Collaborate closely with cross-functional teams, providing leadership and technical guidance to ensure alignment on data architecture and delivery goals.Technical Requirements :- 2+ years of experience in developing, testing, and maintaining applications using Python, Bash, and SQL, with a focus on delivering scalable solutions.- Strong expertise in writing clean, efficient, and maintainable code, with a deep understanding of design patterns and best practices.- In-depth knowledge of SQL and NoSQL databases, including database design and optimization techniques.- Extensive experience with parallel processing and distributed computing frameworks like Hadoop, Spark, or Dask.- Proven track record in custom ETL design, implementation, and operational maintenance in complex environments.- Familiarity with ETL orchestration frameworks such as Luigi, Apache Airflow, or Apache NiFi is an advantage.- Proficiency in backend frameworks like Django or Flask, with demonstrated experience in building and maintaining web services and APIs.- Strong experience with cloud platforms (AWS, GCP, Microsoft Azure), including cloud-based data storage and processing solutions.- Exposure to data analytics, data science, or machine learning workflows is a plus. (ref:hirist.tech)

  • SQL Developer

    3 days ago

    Visakhapatnam, India brabers Full time

    Job Title: SQL Developer (Pharma Domain) – Remote (CET Hours)Location: Fully RemoteType: Long-term Contract / B2B EngagementAvailability: Immediate Start RequiredTime Zone: Central European Time (CET)About the RoleWe are seeking a SQL Developer with hands-on experience in the pharmaceutical industry to join our global pharma client on a long-term contract...

  • Database Developer

    3 weeks ago

    Visakhapatnam, India CareerUS Solutions Full time

    Key Responsibilities:Design, develop, and maintain relational and non-relational databases to support business applications.Write and optimize SQL queries, stored procedures, triggers, and functions for high performance.Collaborate with software developers to design database schemas, data models, and integrations.Ensure data integrity, accuracy, and...

  • Miracle Software Systems

    4 weeks ago

    Visakhapatnam, India Miracle Software Systems Full time

    Position : IDMC DevelopersDuration : Full TimeEXp : 6+ yearsLocation : vishakhapatnamPrimary skills : IDMCJob Description :We are seeking an experienced Informatica Intelligent Data Management Cloud (IDMC) Developer to design, develop, and implement cloud-based data integration and management solutions. The role will focus on building robust ETL/ELT...

  • DataPower Developer

    2 weeks ago

    Visakhapatnam, India Miracle Software Systems Full time

    The desired candidate should be a DataPower expert with over 5 years of experience in the relevant field Able to create XML/MPG and WSP services in DataPower  Should have experience in configuring security concepts such as SSL, AAA, Sign, verify, Encrypt, and Decrypt Proficiency in handling administrative tasks such as DataPower upgrades, reloads, and...

  • Miracle Software Systems

    3 weeks ago

    Visakhapatnam, India Miracle Software Systems Inc Full time

    Description : Looking for IDMC Developer position for Miracle Software Systems Inc, at Vizag location.Position : IDMC Developer.Location : Visakhapatnam.Duration : Permanent.Experience : 4+ Years.About the Role :We are seeking an experienced Informatica Intelligent Data Management Cloud (IDMC) Developer to design, develop, and implement cloud-based data...

  • Miracle Software Systems

    1 week ago

    Visakhapatnam, India Miracle Software Systems Full time

    Position Summary :We are seeking a skilled Azure Data Engineer with hands-on experience in Microsoft Fabric to design, develop, and operationalize data pipelines, semantic models, and historical datasets supporting audit, finance, and operational reporting across RCS. The engineer will collaborate with business, audit, and BI teams to enable audit readiness,...

  • Miracle Software Systems

    3 weeks ago

    Visakhapatnam, India Miracle Software Systems Full time

    Description : Reporting, dashboard development, ETL pipelines, data modelingOverview : - Design, build, and maintain data solutions to support reporting, analytics, and business intelligence : - Develop and maintain ETL pipelines for data ingestion and transformation.- Build dashboards and reports using Power BI, Tableau, or similar tools.- Create and...

  • Senior Data Engineer

    2 weeks ago

    Visakhapatnam, India Miracle Software Systems Full time

    The desired candidate should have over 5 years of experience with a strong emphasis on Snowflake and Matillion ETL Should have experience in troubleshooting and resolving issues related to Matillion ETL processes, ensuring data quality and integrity Experience in traditional RDBMS on both SQL, PL/SQL along with Data warehousing concepts Strong background in...

  • Miracle Software Systems

    1 week ago

    Visakhapatnam, India Miracle Software Systems Full time

    Job Description :- Minimum of 5 years of hands-on experience developing Power BI solutions.- Strong proficiency in DAX, M, and SQL.- Solid understanding of data integration techniques (ETL/ELT) and experience working with tools such as SSIS, Azure Data Factory, or other similar platforms.- Experience with advanced Power BI features such as paginated reports,...

  • Data engineer

    2 days ago

    Visakhapatnam, India Staffingine LLC Full time

    Data Engineer India, Remote Full Time /Contract # of Positions - 3 Job Summary The Data Engineer will be responsible for designing, developing, and optimizing scalable data pipelines and cloud-based data solutions. This role requires strong Python programming skills, expertise in ETL/ELT processes, and deep hands-on experience with AWS cloud services such as...