Bigdata (Pyspark, Hive)
2 months ago
Experience Range: 4 Years to 8 Years
Location: Chennai
**Job Description**:
- Experience in Pyspark and Hive, HBase
- Proficiency in integrating, transforming, andconsolidating data from various structured and unstructured datasources.
- Good experience in SQL or native SQL querylanguages.
- Good experience in PySpark, Hive, Hbase, Hadoop
- Advanced working knowledge in building robustdata ingestion.
- Experience in building processes supporting datatransformation, data structures, metadata, dependency and workload management.
- Exposure to basic issues in working within BigData cluster
Qualifications :BACHELOR OF TECHNOLOGY
-
BigData Engineer
1 week ago
Chennai, Pune, India Talodyn Networks Private Limited Full timeBigdata Developer with PYSpark expStrong experience in PySpark.Strong experience with Python in writing test-cases and Experience in error logging and debugging.Strong experience in Spark, Unix scripting, SparkSQL, Hive.Experience in writing SQLs using Oracle.Excellent oral and written communication skills is a must.Experience in banking is an added...
-
Bigdata Python
6 months ago
Chennai, Tamil Nadu, India RF workforce Solutions Full timeSkill: Bigdata with Python & Pyspark Yrs of experience: 5+ yrs Notice: preferable immediate **Job Types**: Full-time, Temporary Contract length: 6 months Pay: ₹60,000.00 - ₹82,000.00 per month Schedule: - Monday to Friday **Experience**: - Big data: 5 years (required) - python: 5 years (required) - pyspark: 5 years (required) Work Location: In...
-
Pyspark Developer
4 weeks ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timeAbout the RoleWe are seeking an experienced Data Engineer with Pyspark expertise to join our team at Krishpar Technologies Pvt. Ltd.Key ResponsibilitiesDevelop Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Build Machine Learning models using Pyspark.Deploy applications on Cloud platforms.RequirementsAt least 4-7 years...
-
BigData Developer
1 month ago
Chennai, India Kiash Solutions LLP Full time4 + years of expertise and hands on experience in Spark with Scala and Big data technologies Good working experience in Scala and object oriented concepts Good working experience in HDFS, Spark, Hive and Oozie Technical expertise with data models, data mining, and partitioning techniques Hands-on experience with SQL database Have good understand on CI/CD...
-
Pyspark Dev
6 months ago
Chennai, Tamil Nadu, India Virtusa Full timePyspark Dev & QA Mandatory Skills BIG Data technology mentioned below Hadoop / Big Data (HDFS, PYTHON, SPARK-SQL, MapReduce) with PySpark Build CI/CD pipelines is required Outstanding coding, debugging and analytical skills Spark APIs to cleanse, explore, aggregate, transform, store & analyse available data Knowledge of installing, configuring, debugging...
-
Pyspark Developer, Pyspark
1 month ago
Chennai, India Krishpar Technologies Pvt. Ltd Full timeDear candidates,We are hiring for one of our client (MNC) Position : Pyspark DeveloperExperience: 4- 6 YaersLocation: Chennai, BangaloreJob Description: Big Data Testing on Hadoop, Hive, etc., using HiveQL, MapReduce or other big data technologies for automated validation Implementing DevOps / CI-CD using Bitbucket, Jenkins, etc., ...
-
Bigdata ETL Developer
4 weeks ago
Chennai, Tamil Nadu, India RiskInsight Consulting Pvt Ltd Full timeKey Responsibilities: Hands on with in-depth knowledge in BigData ETL Testing.Hands on experience in Hadoop and Hive is a must.Develop Test specifications based on various requirement documents within schedule constraints.Plan and execute activities in relation to test preparation, automation, execution, and reporting.Perform functional and technical test...
-
Senior PySpark Developer
1 month ago
Chennai, Tamil Nadu, India Techno Wise Full timeWe are seeking a highly skilled PySpark Developer to join our team at Techno Wise. As a key member of our data engineering team, you will be responsible for designing and building scalable data solutions using PySpark.Key Responsibilities:Design, build, and unit test applications in Spark/PysparkDevelop in-depth knowledge of Hadoop, Spark, and similar...
-
Pyspark Developer Expert
1 month ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timeAbout the Role:We are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd.Responsibilities:Our ideal candidate will have experience in Big Data testing on Hadoop, Hive, and other technologies using HiveQL, MapReduce, and other big data tools for automated validation.They will also be responsible for implementing...
-
Pyspark Developer
1 month ago
Chennai, Tamil Nadu, India Krishpar Technologies Pvt. Ltd Full timePyspark Developer Job DescriptionWe are seeking a highly skilled Pyspark Developer to join our team at Krishpar Technologies Pvt. Ltd. The ideal candidate will have experience in developing Big Data applications using Pyspark on Hadoop, Hive, and/or Kafka, HBase, and MongoDB.Key Responsibilities:Design and develop scalable and efficient Big Data applications...
-
Bigdata ETL-Testing
8 months ago
Chennai, India RiskInsight Consulting Pvt Ltd Full timeHands on with In-depth knowledge in BigData ETL Testing Experience in Hadoop Hive is a must ETL test automation experience Cloudera experience is good to have Python/spark experience is added advantage Plan and execute activities in relation to test preparation, automation, execution, and reporting Develop Test specifications based on various requirement...
-
Bigdata
3 months ago
Chennai, Tamil Nadu, India Virtusa Full time5+ years of hands-on experience in designing, building and supporting Data Applications using Spark, Sqoop and Hive Bachelors or masters degree in Computer Science or related field Strong knowledge of working with large data sets and high-capacity big data processing platform Strong experience in Unix and Shell scripting Advanced knowledge of the Hadoop...
-
Big Data Developer
4 weeks ago
Chennai, India Globalemployees.com Full timePosition Name : Big Data developerDesired Skills and Experience :- AWS, EC2, HDFS, HQL, EMR, Sqoop- Strong Knowledge of Bigdata and Hadoop ecosystems like HDFS, Spark, MapReduce, Sqoop, Hive and AWS.- Experience in Loading and transforming large sets of structured, semi-structured and unstructured data from Relational Database Systems to HDFS and vice-versa...
-
Bigdata
1 week ago
Chennai, Tamil Nadu, India Tata Consultancy Services Full timeTCS has been a great pioneer in feeding the fire of young Techies like you. We are a global leader in the technology arena and there's nothing that can stop us from growing together. As an Analyst, you will specialize in requirement gathering and to analyze the same in respective areas. Your role is of key importance, as it lays down the foundation for the...
-
BigData - Tech Lead
5 months ago
Chennai, India Virtusa Full timeBigData - Tech Lead - CREQ186711 Description Job Description: Responsibilities: Responsible for Design, Build & deployment the Solution in Bigdata. Ability to effectively use complex analytical, interpretive and problem solving techniques. Analytical, flexible, team-oriented and has good interpersonal/communication skills. Apply...
-
Principle Data Engineer
2 months ago
Chennai, India Cynosure Corporate Solutions Full timeSkills &Experience:10years of design & development experience with big datatechnologies like Azure AWS orGCPMinimum 6Years in PysparkExperiencePreferred is Azure& Databricks with experience in AzureDevOpsExperience in datavisualizing technology in DL likePowerBIProficient in Python PySparkand SQLProficient in querying andmanipulating data from various DB...
-
Data Engineer
3 months ago
Chennai, India TekPillar Full timeJob Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, PythonJob Description :We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.- Strong experience with AWS services: Glue,...
-
Data Engineer
3 weeks ago
tamil nadu, India Tata Consultancy Services Full timeTCS Hiring !!!! VIRTUAL DRIVE: Azure Data Engineer Developer : 07-November-24 NOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization...
-
Data Engineer
3 weeks ago
tamil nadu, India Tata Consultancy Services Full timeTCS Hiring !!!! VIRTUAL DRIVE: Azure Data Engineer Developer : 07-November-24 NOTE: If the skills/profile matches and interested, please reply to this email by attaching your latest updated CV and with below few details: Name: Contact Number: Email ID: Highest Qualification in: (Eg. B.Tech/B.E./M.Tech/MCA/M.Sc./MS/BCA/B.Sc./Etc.) Current Organization...
-
Big Data Engineer
2 weeks ago
Chennai, India Changeleaders Full timeJob Summary : We are seeking a highly skilled and motivated Big Data Engineer to join our dynamic team. The ideal candidate will have hands-on experience in designing, developing, and optimizing scalable big data pipelines and solutions. This role requires proficiency in advanced big data tools, technologies, and programming languages.Key Responsibilities :...