SQL Developer

4 weeks ago

Hyderabad, Telangana, India HireIT Consultants Full time

SQL Developer with PySpark Coding Job Description

Job Title : SQL Developer with PySpark Coding

Job Summary : We are seeking an experienced SQL Developer with expertise in PySpark to join our dynamic data engineering team.

The ideal candidate will be proficient in SQL for querying and managing large datasets, and have hands-on experience in using PySpark to process and analyze big data efficiently. You will work on designing, implementing, and maintaining data pipelines and ensuring data accuracy, integrity, and performance in a cloud or on-premise environment.

Key Responsibilities :

SQL Development :

- Write, optimize, and maintain complex SQL queries and stored procedures.

- Create, modify, and manage database objects such as tables, views, indexes, and triggers.

- Collaborate with business analysts and data scientists to understand requirements and build efficient SQL queries.

- Perform database performance tuning, optimization, and troubleshooting.

PySpark Development :

- Design and implement data processing pipelines using PySpark to process large volumes of data.

- Develop scalable and efficient distributed data processing solutions.

- Use PySpark to extract, transform, and load (ETL) data from various sources into data lakes or warehouses.

- Work with large datasets stored in Hadoop, AWS, or Azure environments.

Data Integration :

- Work with various data sources like relational databases, NoSQL databases, flat files, cloud storage (e.g., AWS S3, Azure Blob Storage), and APIs to integrate data.

- Perform data cleansing, transformation, and enrichment using PySpark and SQL.

- Ensure high data quality and consistency across systems.

Collaboration and Reporting :

- Collaborate with data engineers, data scientists, and business intelligence teams to ensure data availability and quality.

- Develop and maintain automated reports and dashboards for stakeholders.

- Assist in troubleshooting and resolving any data-related issues in production systems.

Data Governance and Security :

- Ensure that data governance and security protocols are adhered to during the ETL processes and throughout the data pipeline.

- Maintain data documentation and metadata for transparency and regulatory compliance.

Optimization and Scaling :

- Continuously analyze and optimize SQL queries and PySpark jobs for better performance.

- Implement best practices for working with big data processing frameworks and manage performance at scale.

Continuous Learning and Development :

- Stay up to date with the latest advancements in SQL, PySpark, and big data technologies.

- Participate in training and development opportunities to improve skills and knowledge.

Required Skills and Qualifications :

SQL : Strong proficiency in SQL, including advanced querying techniques, stored procedures, functions, and database design.

PySpark : Solid experience in PySpark for big data processing and familiarity with Spark's architecture (RDDs, DataFrames, Datasets).

Data Warehousing & ETL : Experience working with data lakes, data warehouses, and ETL pipelines.

Cloud Platforms : Hands-on experience with cloud platforms like AWS (Redshift, S3, EMR), Azure (Azure Data Lake, Azure Synapse), or GCP.

Programming : Proficiency in Python, including the use of PySpark for parallel data processing.

Big Data Technologies : Familiarity with Hadoop ecosystem components (Hive, HDFS, YARN, etc.) and Spark-related technologies.

Database Technologies : Familiarity with relational databases (e.g., SQL Server, PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

Version Control : Experience with Git or other version control systems for managing code.

Data Modeling : Experience in data modeling and understanding of normalization/denormalization techniques.

Analytical Skills : Strong problem-solving and analytical skills with the ability to work with large datasets and extract actionable insights.

Preferred Qualifications :

- Bachelor's degree in Computer Science, Engineering, or a related field.

- Experience with data orchestration tools like Apache Airflow or similar.

- Familiarity with machine learning models and integration with big data processing frameworks.

- Experience with data visualization tools (Tableau, Power BI, etc.) is a plus.

Working Environment : Full-time position.

- Flexible work hours with potential for remote work.

- Collaborative, fast-paced environment.

- Opportunities for growth and skill development in emerging data technologies.

This role offers the opportunity to work on cutting-edge data solutions in a fast-paced and innovative environment. If you are passionate about data engineering and enjoy working with both SQL and big data frameworks like PySpark, we'd love to have you on our team

(ref:hirist.tech)

  • SQL Developer

    2 days ago

    Hyderabad, Telangana, India Programmers Full time

    Job Description:Programmers looking for an experienced and skilled SQL Developer to join our team. The ideal candidate will have deep expertise in SQL development with hands-on experience in Azure SQL Database, Azure Parallel Data Warehouse, Linked Servers, and Database Replication. You will be responsible for optimizing database performance, implementing...

  • SQL Developer

    1 day ago

    Hyderabad, Telangana, India Programmers Full time

    Job Description: Programmers looking for an experienced and skilled SQL Developer to join our team. The ideal candidate will have deep expertise in SQL development with hands-on experience in Azure SQL Database , Azure Parallel Data Warehouse , Linked Servers , and Database Replication . You will be responsible for optimizing database performance,...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India 4Bell Technology Full time

    Responsibilities : 1. Design, implement, and maintain database structures.2. Develop and update existing stored procedures and functions using T-SQL.3. Research required data and develop complex SQL queries.4. Develop procedures and scripts for data migration.5. Ensure performance, security, and availability of databases.6. Collaborate with other team...

  • Sql Developer

    2 weeks ago

    Hyderabad, Telangana, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking an experienced SQL Developer to join our team in India. The ideal candidate will have a strong background in database design and development, with a focus on optimizing performance and ensuring data integrity.Responsibilities- Design, develop, and maintain SQL databases and data models.- Write efficient, reusable, and...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India V-Soft Consulting Corporation Private Limited Full time

    SQL DBA Developer. Location : Pan India(Hybrid Mode). Exp : 7 to 9 Years. Key Responsibilities : - Design, develop, and implement database solutions using SQL Server. - Write complex SQL queries, stored procedures, functions, and triggers. - Optimize database performance through indexing, query tuning, and other techniques. - Install, configure, and maintain...

  • Sql Developer

    4 days ago

    Hyderabad, Telangana, India Maaxtreem Full time

    Job DescriptionDescriptionWe are seeking a highly motivated SQL Developer to join our team. This role is ideal for freshers or entry-level candidates who are eager to learn and grow in the field of database development and management.Responsibilities- Designing, developing and maintaining SQL databases- Writing complex SQL queries for data extraction and...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India GTECH Full time

    Job Title : SQL Developer. Project Location : HYD. Client. Banking domain. Notice period : Max up to 30 days who is currently serving it only. Duration : Fulltime role. Mode of interview : Videos. Responsibilities : - Design, develop, and implement complex database solutions using SQL Server, Oracle, or other relational database systems. - Create and...

  • SQL Developer

    1 week ago

    Hyderabad, Telangana, India Robotics Technologies Full time

    Job DescriptionDescriptionWe are seeking a highly skilled SQL Developer with 10-20 years of experience to join our dynamic team in India. The ideal candidate will be responsible for designing, developing, and maintaining our SQL databases, ensuring high performance and availability.Responsibilities- Designing, developing, and maintaining SQL databases and...

  • SQL Developer

    4 weeks ago

    Hyderabad, Telangana, India Infotech Consultancy Global Pvt Ltd Full time

    Job Description :- 4+ Years of Experience in SQL/PLSQL Development : Extensive experience in writing, optimizing, and maintaining SQL queries and stored procedures.- Strong SQL Knowledge : In-depth understanding of SQL syntax, functions, and advanced SQL concepts. Proficiency in PLSQL is essential.- Performance Tuning : Solid understanding of query...

  • SQL Developer

    1 week ago

    Hyderabad, Telangana, India Data Unveil Full time

    Job Summary : We are seeking a highly motivated and experienced Senior SQL Developer to join our dynamic team in Hyderabad. The ideal candidate will possess a strong background in SQL development, with a proven ability to translate complex business requirements into efficient technical solutions. You will play a key role in optimizing database performance,...

  • SQL Developer

    2 hours ago

    Hyderabad, Telangana, India GTECH Full time

    Job Title : SQL Developer. Project Location : HYD. Client. Banking domain. Notice period : Max up to 30 days who is currently serving it only. Duration : Fulltime role. Mode of interview : Videos. Responsibilities :- Design, develop, and implement complex database solutions using SQL Server, Oracle, or other relational database systems.- Create and maintain...

  • SQL Developer

    4 weeks ago

    Hyderabad, Telangana, India Bigtapp Analytics Full time

    Job Title : MS SQL Developer Location : Hyderabad Experience : 3 - 5 Years Primary Skills : MS SQL SERVER,Oracle Sql Developer,MY SQL Secondary Skills : Job Monitoring,Backup and Recovery,Life Insurance Roles And Responsibilities : Job Summary : We are seeking a highly skilled MS SQL Developer with 5+ years of experience to join our dynamic team in...

  • SQL Developer

    3 weeks ago

    Hyderabad, Telangana, India Visual Micron Full time

    Responsibilities:* Develop and optimize complex SQL queries and stored procedures.* Create and maintain SQL Server Reporting Services(SSRS) reports and dashboards.* Collaborate with business stakeholders to gather requirements and translate them into technical specifications.* Ensure data quality and integrity through effective data management practices.*...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India Visual Micron Full time

    Responsibilities:* Develop and optimize complex SQL queries and stored procedures.* Create and maintain SQL Server Reporting Services(SSRS) reports and dashboards.* Collaborate with business stakeholders to gather requirements and translate them into technical specifications.* Ensure data quality and integrity through effective data management practices.*...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India Data Unveil Full time

    Job Summary : We are seeking a highly motivated and experienced Senior SQL Developer to join our dynamic team in Hyderabad. The ideal candidate will possess a strong background in SQL development, with a proven ability to translate complex business requirements into efficient technical solutions. You will play a key role in optimizing database performance,...

  • SQL Developer

    1 week ago

    Hyderabad, Telangana, India Data Unveil Full time

    Job Summary : We are seeking a highly motivated and experienced Senior SQL Developer to join our dynamic team in Hyderabad. The ideal candidate will possess a strong background in SQL development, with a proven ability to translate complex business requirements into efficient technical solutions. You will play a key role in optimizing database performance,...

  • SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India Tata Consultancy Services Full time

    Role: SSIS SQL DeveloperExp: 5-8Loc: Hyderabad

  • SQL Database Developer

    4 days ago

    Hyderabad, Telangana, India Maaxtreem Full time

    Job DescriptionDescriptionWe are seeking an experienced SQL Database Developer to join our team in India. The ideal candidate will have a strong background in SQL database design, development, and optimization, and will be responsible for ensuring the performance, integrity, and security of our databases.Responsibilities- Design, develop, and maintain SQL...

  • PL SQL Developer

    2 weeks ago

    Hyderabad, Telangana, India Foundit Full time

    Job DescriptionAbout the ClientWe are partnering with, a globally recognized IT services provider known for delivering database management and enterprise solutions. And in seeking a skilled PL/SQL Developer to join their team and contribute to building and optimizing Oracle database solutions.Job Summary:The PL/SQL Developer will be responsible for...

  • SQL Developer

    1 week ago

    Hyderabad, Telangana, India Circuit Compilers Full time

    Database Design and Development : - Design, develop, and implement new SQL databases and data warehousing solutions, including data modeling, table creation, stored procedures, and views.- Optimize existing database schemas for performance and scalability.- Implement and maintain data warehouse ETL (Extract, Transform, Load) processes.- Manage and maintain...