Responsibilities

• Designing, Creating, & Maintaining data management & processing systems
• Taking care of the complete ETL process
• Experience of structured and unstructured data, including integrating data from multiple sources
• Discovering data acquisitions opportunities
• Improving Data Quality, Reliability & Efficiency of the system

Skil Requirements:

• 3 – 6 years of recent experience in Big Data Engineering
• Should have Experience in
• AWS Cloud (Glue, Athena, Redshift, Talend OR Altery)
• Data Processing: Hadoop, Hive, Spark, Scala, Python, Pyspark
• NOSQL Database: Mongo DB (or Any One)
• Data Ingestion: Sqoop, Flume or Any one ETL

Nice to Have:

• Experience on Kafka, Oozie, IG
• Real-time processing Framework (Apache Spark)
• SQL-based technologies (e.g. MySQL etc.)
• Experience in ELK (elastic search, logstash, kibana)