Senior Data Engineer
3 weeks ago
Job Description:
We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field.
The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations.
This role offers an exciting opportunity to work on cutting-edge projects, contribute to the design and architecture of applications, and collaborate closely with business users.
Key Responsibilities:
- Data Engineering: Hands-on experience in PySpark, including Dataframe core functions and Spark SQL, for data processing and analytics.
- SQL Databases: Proficiency in SQL databases to write queries of varying complexity for data retrieval and manipulation.
- Big Data Programming: Experience in Big Data programming for data transformation, aggregations, and analytics.
- Customer Communication: Excellent communication skills to interact effectively with customers and stakeholders.
- Analytical Skills: Strong analytical skills to understand complex data requirements and troubleshoot issues effectively.
- Design & Architecture: Contribute to the overall design and architecture of applications developed and deployed.
- Performance Tuning: Optimize application performance by tuning executor sizing, environmental parameters, code optimization, and partition tuning.
- Requirements Gathering: Interact with business users to understand their requirements and translate them into functional specifications.
- Project Implementation: Implement projects based on functional specifications, ensuring timely and accurate Bachelor's/Master's degree in Computer Science, Information Systems, or a related field.
- Minimum of 5+ years of experience in data engineering.
- Strong proficiency in PySpark, Python, Spark, and SQL.
- Experience with Big Data technologies and programming languages.
- Excellent communication and interpersonal skills.
- Strong analytical and problem-solving abilities.
Technical Skills & Competencies:
- Expertise in PySpark, Python, Spark, and SQL.
- Hands-on experience in Big Data programming and analytics.
- Ability to design and architect data solutions.
- Strong performance tuning skills.
- Excellent communication and collaboration skills.
- Detail-oriented with a focus on quality and accuracy.
-
Senior Machine Learning Engineer
3 weeks ago
Any Location, IN K2 Data & Analytics Full timeJob Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...
-
Senior Backend Engineer
3 weeks ago
Any Location, IN K2 Data & Analytics Full timeJob Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...
-
Senior Data Engineer
3 weeks ago
Bangalore/Any Location, IN SWAI TECHNOLOGIES PRIVATE LIMITED Full timeJob Description :We are seeking a highly skilled Senior Data Engineer with 5 - 12 years of experience in building scalable data solutions. The ideal candidate should be proficient in Python programming and SQL, with extensive experience in utilizing various AWS services for data processing and storage.Experience with big data processing environments,...
-
Harmony Data Integration Technologies
3 days ago
Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...
-
Senior Data Warehouse Engineer
2 weeks ago
Bangalore/Any Location, IN TalentXo Full timeCriteria :Role : Strong Senior Data Warehouse/Data Engineer - Must have more than 8+ YOE in Software Development- Must have 6+ YOE in Data Ware house/Data Engineering and Data Modelling- Must have strong work experience in Any Dataware House / Data Lake- Must have Good Experience in SQL on any databases MySQL / PostgreSQL / Postgres / Oracle / SQL Server /...
-
Senior Data Engineer
3 weeks ago
Any Location, IN Muoro Full timeRole & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...
-
Harmony Data Integration Technologies
3 days ago
Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full timeJob Description :As a Senior Software Engineer, you will play a pivotal role in the design, development, and implementation of robust software solutions. Your key responsibilities will include, but not limited to,architecting scalable and maintainable systems, hands-on coding, crafting robust unit tests, conducting thorough code reviews, and collaborating...
-
Data Engineer
3 weeks ago
Bangalore/Any Location, IN INSIGHT GLOBAL SOLUTIONS Full timeData Engineer Must Haves :- Bachelors Degree in science, technology, or another related field.- 3+ years of data engineering experience.- 3+ years of experience with Cloud platforms like GCP, Azure, Airflow.- 4+ years of data warehouse, relational database, and SQL experience.- 4+ years of supporting ETL process and job scheduling experience.- 3+ years of...
-
Data Visualization Engineer
3 weeks ago
Any Location, IN Mobile Programming LLC Full timeJob Description : Mobile Programming is urgently hiring for a Data visualization Engineer who is responsible for the graphical representation of information and data. To be successful in this field, you must have knowledge of visual elements like charts, graphs, and maps, data visualization tools provide an accessible way to see and understand trends,...
-
Senior Data Scientist
3 weeks ago
Any Location/Bangalore, IN NLB Services Full timeSenior Data Scientist role for one of our product based company in Bangalore location.Notice Period : Immediate to 30Days. Location : Bangalore.Skills : Python, LLM, NLP and Problem solving. Company Description : Founded in 2007, NLB Services is a global technology and digital talent solutions provider. Headquartered in Alpharetta, Georgia (USA), we have a...
-
Data Engineer
1 week ago
Any Location, IN Reliable Group Full timePOSITION DESCRIPTION :WHAT YOU'LL DO :- Architect, Design, document & implement the data pipelines to feed data models for subsequent consumption in Snowflake using dbt, airflow.- Ensure correctness and completeness of the data being transformed via engineering pipelines for end consumption in Analytical Dashboards.- Actively monitor and triage technical...
-
Senior Data Analyst
2 weeks ago
Any Location/Bangalore, IN TalentXo Full timeThe OpportunityWe're seeking a highly motivated Senior Data Analyst to join our dynamic Data Science team. In this role, you'll play a vital role in the entire data analytics lifecycle, from data acquisition and cleaning to analysis, visualization, and reporting. You'll collaborate closely with cross-functional teams to leverage data insights to...
-
Data Engineer
3 weeks ago
Any Location, IN Muoro Full timeResponsibilities :- Design, develop, and maintain robust data pipelines using Apache Spark, Python, and other relevant technologies.- Implement data ingestion processes from various sources, ensuring data quality and integrity.- Optimize and tune data pipelines for performance and scalability.- Collaborate with data scientists and analysts to deploy machine...
-
Senior Backend Engineer
1 week ago
Any Location, IN Primo Hiring Solutions Full timeRole Description :This is a full-time remote role for a Senior Backend Engineer. As a Senior Backend Engineer, you will be responsible for designing, developing, and maintaining the server-side of web applications and APIs. You will collaborate with cross-functional teams to understand business requirements and translate them into scalable, reliable, and...
-
Azure Data Engineer
3 weeks ago
Any Location, IN Visionyle Full timePosition Name: Azure Data EngineerPosition Mode: PermanentExperience: 6 YearsJoining Location: RemoteNotice: ImmediateMode of Interview : 2-3 roundsSUMMARY:Azure Data Engineer should have experience on Azure data lake, Azure SQL database, Databricks, Azure Data Factory, and Azure SQL data warehouse and controlling and granting database access and migrating o...
-
Azure Data Engineer
3 weeks ago
Any Location/Bangalore, IN Zyoin group Full timeSkills :Proficiency in Azure Data EngineeringStrong expertise in SSIS (SQL Server Integration Services)Extensive experience in ETL (Extract, Transform, Load) processesAdvanced skills in Power BI for data visualization and analyticsResponsibilities :Design, develop, and implement data solutions leveraging Azure Data Engineering services.Utilize SSIS for...
-
Data Engineer
5 days ago
Any Location/Bangalore, IN RS Consultants Full timeAbout the job :Responsibilities :- Build, document, test and launch new data extract, transform and load (ETL) processes for one or more core data sets.- Collaborate with Business Intelligence team and other stakeholders for data requirements- Collaborate with the Data Management team to provide quality data to stakeholders.- Build data expertise and learn...
-
Azure Data Engineer
3 weeks ago
Any Location/Bangalore, IN Diatoz Solutions Full timeWe Are Seeking A Skilled Azure Data Engineer To Join Our Dynamic Team. The Ideal Candidate Will Be Responsible For Designing, Developing, And Maintaining Data Solutions On The Microsoft Azure Platform. You Will Collaborate With Cross-Functional Teams To Gather Requirements, Design Data Pipelines, And Implement Solutions To Meet Business...
-
Senior DevOps/Site Reliability Engineer
5 days ago
Any Location, IN RapidBraiins Full timeJob Description :We are seeking a highly skilled and experienced Senior DevOps Site Reliability Engineer to join our dynamic team. The ideal candidate will have a proven track record of success in DevOps, Site Reliability Engineering (SRE), or development roles within SaaS-based or enterprise applications. As a Senior DevOps SRE Engineer, you will play a...
-
Senior DevOps Engineer
3 weeks ago
Any Location, IN Talentsyker Full timeWe are looking for a senior devops engineer to join our cutting-edge infra team as it grows. We want someone comfortable asking why.- The ideal candidate is a divergent thinker who understands industry best practices and has experience with multiple cloud platforms like aws and azure.- The devops engineer will be a part of a dynamic team that is responsible...