Job Opportunities API

Responsibilities 5+ years of experience utilizing Python, PySpark/Scala for processing large data volumes Good knowledge of working with Databases (e.g., SQL, Oracle, Hive, Impala) Relevant experience with Pandas, NumPy, Scikit-learn, and other relevant Python libraries Google Cloud Platform (DataProc, AirFlow, Google Cloud Storage) Good knowledge of Unix/Linux environments Familiarity with Big Data and Hadoop Ecosystem: Spark (Spark SQL, Dataframes, PySpark, HUE, parquet files) Awareness about DevOps practices like CI/CD Proficient communication and English language skills (written/verbal) Skills PySpark (Python, PySpark or Scala) Spark DataFrames ETL concepts Database and SQL knowledge (Hive/Impala)