Data Analyst.
- Data Analysts are experienced data professionals in their organization who can query and process data, provide reports, summarize, and visualize data.
- They have a strong understanding of how to leverage existing tools
- And methods to solve a problem and help people from across the company understand specific queries with ad-hoc reports and charts.
Key Skills and responsibilities.
- Data Analysts need to have a baseline understanding of some core skills: statistics, data munging, data visualization, exploratory data analysis,
Tools: Microsoft Excel, SPSS Modeler, SAS, SAS Miner, SQL, Microsoft Access, Tableau, SSAS.
Data Engineer.
- Data engineers build and maintain the systems that allow data scientists to access and interpret data.
- The role generally involves creating data models, building data pipelines, and overseeing ETL (extract, transform, load).
- Data scientists build and train predictive models using data after cleaning.
Key Responsible of the Data Engineers in the Sri Lanka.
- Gather requirements, assess gaps, and build roadmaps and architectures.
- Work closely with Data Analysts to ensure data quality and availability for analytical modelling.
- learn how to explore suitable options, design, and create data pipelines for specific analytical solutions.
- Support maintenance, bug fixing and performance analysis along data pipeline.
- Knowledge of machine learning and deep learning algorithms.
- Solid understanding of data structures and algorithms, no-SQL databases etc.
- Has DevOps tooling user skillset in using Jira/Confluence, GIT and a CICD tool.
- Design, develop and implement Big Data platforms using Cloud architecture.
Collaborate with technical teams to develop and maintain a flexible framework
- Interact with the Business divisions to understand all data requirements to develop business insights for Octave
and translate them into data structures and data model requirements
- Create and maintain vendor relationships to stay abreast with latest big data technology and solutions.
Desired Skills / Competencies for the Data Engineers in the Sri Lanka.
Education + Technical skills / experience
- Bachelor’s degree in Computer Science, Engineering, Mathematics or Statistics.
- Experience in building real-time processing pipelines using Spark-streaming or Flank
- Working experience in data ingestions pipeline
- Working experience in Bash and Linux Environments.
Skills for senior data engineer.
Master’s degree in Computer Science, Engineering, Mathematics or Statistics
- 10+ years of experience with the tech stack required for analytics and enterprise systems
- Expertise in developing applications in a high volume ETL environment and proficiency in advanced SQL skills; master data management.