Position: Pyspark Developer with SAS Knowledge
Key Responsibilities:
- Analyze and understand existing SAS programs and datasets
- Design and develop PySpark code that replicates the functionality of existing SAS programs
- Optimize PySpark code for performance and scalability
- Test and validate PySpark code to ensure it produces the same results as the original SAS programs
- Identify and resolve issues and discrepancies in the migration process
- Collaborate with data engineers, data scientists, and business stakeholders to define and implement data processing pipelines
• * Requirements**:
- Experience with SAS programming and analytics, Spark and AWS.
- Experience with SQL and No
SQL databases
- Strong programming skills in Python and experience with data manipulation, Data ingestion and data anlalytics.
- Experience with distributed computing systems, such as Hadoop, Spark, or Databricks
• * Benefits*
• SGD 6500 - 8500 per Month
