lshang0311 Goto Github PK

followers: 12.0 following: 68.0 repos: 95.0 gists: 1.0

Name: Lei Shang

Type: User

Bio: Data Scientist

Location: Sydney, Australia

Hi there 👋

I'm Lei Shang. Thanks for visiting my GitHub space!
🔭 I'm currently working on Generative AI frameworks, exploring use cases and the underlying technology.
📫 Feel free to reach out for a chat if you come across something interesting:
- LinkedIn
- Medium
- Email: lei.shang AT hotmail.com

Portfolio Contents

Generative AI
Data Science in Action
Programming Languages
Data Science Toolkit
MLOps
Cloud Computing
Clean Code
Research

Generative AI

Exploring the Trend, Technology, and Latest Advances

Topic	Code/Link
AI Agents	AutoGen, CrewAI
Finetuning LLMs	How to Fine-Tune LLMs in 2024 with Hugging Face
RAGs	Introducing RAGs: Your Personalized ChatGPT Experience Over Your Data
Prompt Engineering	🚧
Notes	Generative AI Notes
LLM Architectures and Applications	Emerging Architectures for LLM Applications
LangChain Core Concepts (Chains, Agents, Tools)	🚧

Data Science in Action

Real-World Applications and Case Studies

Topic	Code/Link
LLM empowered sentiment analysis	🚧
Scale document question answering using LLMs	🔗
Efficiently Applying LLMs to Transform Semi-Structured Data	News; Code and Paper
LLM empowered personalisation and recommendation systems	🚧
Question Answering Over Documents through RAG (Retrieval Augmented Generation)	🚧
Predicting the Financial Market with Large Language Models	🔗

Programming Languages

Topic	Code/Link
Scala	Scala

Data Science Toolkit

Topic	Code/Link
Pandas	Pandas examples
Docker	🚧

MLOps

Productionising machine learning models

Topic	Code/Link
FastAPI and Docker Compose	Quick Start with FastAPI and Docker
Vertex AI	🚧
AWS SageMaker	🚧 Deploy a serverless ML inference endpoint of large language models using FastAPI, AWS Lambda, and AWS CDK
AWS Lambda	🚧 (An example using FastAPI, Docker and AWS Lambda)
Kubeflow	🚧
MLflow and Kubernetes	ML deployment examples
Terraform	🚧

Cloud Computing

Topic	Code/Link
AWS	🚧
GCP	🚧
MS Azure	🚧

Clean Code

Topic	Code/Link
LeetCode	🚧
SOLID Principles in Python	🚧

Research

Papers & Books that I'm following

Topic	Code/Link
Efficient Finetuning of Quantized LLMs	QLoRA
ChatGPT	How Is ChatGPT’s Behavior Changing over Time?
NLP	Attention Is All You Need
Time Series Forecasting	Deep GPVAR: Upgrading DeepAR For Multi-Dimensional Forecasting
LLM	Aligning language models to follow instructions
LLM	Making fine-tuning cheap & accessible
LLM	Llama-2 7B Chat
LLM	Data Mining Research Group at Tsinghua University
Bayesian Modeling and Computation	Bayesian Modeling and Computation in Python
Statistics and Data Analysis	Statistical Thinking for the 21st Century
Reinforcement Learning	Reinforcement Learning: An Introduction
AWS Labs	https://github.com/awslabs

Lei Shang's Projects

akka-java-examples

Example implementation of various akka patterns in Java

amazon-accessible-rl-sdk

A2RL is a Python library for offline reinforcement learning

amazon-sagemaker-examples

Example notebooks that show how to apply machine learning and deep learning in Amazon SageMaker

anomaly-detection-with-auto-encoders

auto-gpt

An experimental open-source attempt to make GPT-4 fully autonomous.

autogen

A programming framework for agentic AI. Discord: https://aka.ms/autogen-dc. Roadmap: https://aka.ms/autogen-roadmap

autogptq

An easy-to-use LLMs quantization package with user-friendly apis, based on GPTQ algorithm.

awesome-llms-in-graph-tasks

A curated collection of research papers exploring the utilization of LLMs for graph-related tasks.

azure-cognitive-search-azure-openai-accelerator

Virtual Assistant - GPT Smart Search Engine - Bot Framework + Azure OpenAI + Azure Search + Azure SQL + Azure Document Intelligence + LangChain + CosmosDB

A sample app for the Retrieval-Augmented Generation pattern running in Azure, using Azure Cognitive Search for retrieval and Azure OpenAI large language models to power ChatGPT-style and Q&A experiences.

blog

Code samples associated with my blog posts

btreebot

Tank royale (robocode) bot

chatdev

Create Customized Software using Natural Language Idea (through LLM-powered Multi-Agent Collaboration)

clean-code

corenlp

Stanford CoreNLP: A Java suite of core NLP tools.

crewai

Framework for orchestrating role-playing, autonomous AI agents. By fostering collaborative intelligence, CrewAI empowers agents to work together seamlessly, tackling complex tasks.

deep-learning-101

Deep Learning Tutorials

deeplearning

deeplearning-gpu

Deep learning with GPU

deeplearning4j

Deep Learning for Java, Scala & Clojure on Hadoop & Spark With GPUs - From Skymind

dl_tutorials

Deep learning tutorials (2nd ed.)

dolly

Databricks’ Dolly, a large language model trained on the Databricks Machine Learning Platform

ds-spark-hadoop

Practical Data Science with Hadoop and Spark

example-project

Example Python DS project

fastapi-alembic-sqlmodel-async

This is a project template which uses FastAPI, Alembic and async SQLModel as ORM. It shows a complete async CRUD using authentication and role base access control.

fastapi-docker-quickstart

finsight

FinSight - Financial Insights at Your Fingertip: FinSight is a cutting-edge AI assistant tailored for portfolio managers, investors, and finance enthusiasts. It streamlines the process of gaining crucial insights and summaries about a company in a user-friendly manner.