mirror of
https://github.com/trailofbits/algo.git
synced 2025-08-16 01:32:58 +02:00
Add Claude Code GitHub Workflow (#14798)
* "Claude PR Assistant workflow" * "Claude Code Review workflow" * docs: Add CLAUDE.md for LLM guidance This comprehensive guide captures important context and learnings for LLMs working on the Algo VPN codebase, including: - Project architecture and structure - Critical dependencies and version management - Development practices and code style - Testing requirements and CI/CD pipeline - Common issues and solutions - Security considerations - Platform support details - Maintenance guidelines The guide emphasizes Algo's core values: security, simplicity, and privacy. It provides practical guidance based on extensive experience working with the codebase, helping future contributors maintain high standards while avoiding common pitfalls. * feat: Configure Claude GitHub Actions with Algo-specific settings - Add allowed_tools for running Ansible, Python, and shell linters - Enable use_sticky_comment for cleaner PR discussions - Add custom_instructions to follow Algo's security-first principles - Reference CLAUDE.md for project-specific guidance
This commit is contained in:
parent
be744b16a2
commit
d961f1d7e0
3 changed files with 437 additions and 0 deletions
78
.github/workflows/claude-code-review.yml
vendored
Normal file
78
.github/workflows/claude-code-review.yml
vendored
Normal file
|
@ -0,0 +1,78 @@
|
||||||
|
name: Claude Code Review
|
||||||
|
|
||||||
|
on:
|
||||||
|
pull_request:
|
||||||
|
types: [opened, synchronize]
|
||||||
|
# Optional: Only run on specific file changes
|
||||||
|
# paths:
|
||||||
|
# - "src/**/*.ts"
|
||||||
|
# - "src/**/*.tsx"
|
||||||
|
# - "src/**/*.js"
|
||||||
|
# - "src/**/*.jsx"
|
||||||
|
|
||||||
|
jobs:
|
||||||
|
claude-review:
|
||||||
|
# Optional: Filter by PR author
|
||||||
|
# if: |
|
||||||
|
# github.event.pull_request.user.login == 'external-contributor' ||
|
||||||
|
# github.event.pull_request.user.login == 'new-developer' ||
|
||||||
|
# github.event.pull_request.author_association == 'FIRST_TIME_CONTRIBUTOR'
|
||||||
|
|
||||||
|
runs-on: ubuntu-latest
|
||||||
|
permissions:
|
||||||
|
contents: read
|
||||||
|
pull-requests: read
|
||||||
|
issues: read
|
||||||
|
id-token: write
|
||||||
|
|
||||||
|
steps:
|
||||||
|
- name: Checkout repository
|
||||||
|
uses: actions/checkout@v4
|
||||||
|
with:
|
||||||
|
fetch-depth: 1
|
||||||
|
|
||||||
|
- name: Run Claude Code Review
|
||||||
|
id: claude-review
|
||||||
|
uses: anthropics/claude-code-action@beta
|
||||||
|
with:
|
||||||
|
anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
|
||||||
|
|
||||||
|
# Optional: Specify model (defaults to Claude Sonnet 4, uncomment for Claude Opus 4)
|
||||||
|
# model: "claude-opus-4-20250514"
|
||||||
|
|
||||||
|
# Direct prompt for automated review (no @claude mention needed)
|
||||||
|
direct_prompt: |
|
||||||
|
Please review this pull request and provide feedback on:
|
||||||
|
- Code quality and best practices
|
||||||
|
- Potential bugs or issues
|
||||||
|
- Performance considerations
|
||||||
|
- Security concerns
|
||||||
|
- Test coverage
|
||||||
|
|
||||||
|
Be constructive and helpful in your feedback.
|
||||||
|
|
||||||
|
# Optional: Use sticky comments to make Claude reuse the same comment on subsequent pushes to the same PR
|
||||||
|
use_sticky_comment: true
|
||||||
|
|
||||||
|
# Optional: Customize review based on file types
|
||||||
|
# direct_prompt: |
|
||||||
|
# Review this PR focusing on:
|
||||||
|
# - For TypeScript files: Type safety and proper interface usage
|
||||||
|
# - For API endpoints: Security, input validation, and error handling
|
||||||
|
# - For React components: Performance, accessibility, and best practices
|
||||||
|
# - For tests: Coverage, edge cases, and test quality
|
||||||
|
|
||||||
|
# Optional: Different prompts for different authors
|
||||||
|
# direct_prompt: |
|
||||||
|
# ${{ github.event.pull_request.author_association == 'FIRST_TIME_CONTRIBUTOR' &&
|
||||||
|
# 'Welcome! Please review this PR from a first-time contributor. Be encouraging and provide detailed explanations for any suggestions.' ||
|
||||||
|
# 'Please provide a thorough code review focusing on our coding standards and best practices.' }}
|
||||||
|
|
||||||
|
# Optional: Add specific tools for running tests or linting
|
||||||
|
allowed_tools: "Bash(ansible-playbook * --syntax-check),Bash(ansible-lint *),Bash(ruff check *),Bash(yamllint *),Bash(shellcheck *),Bash(python -m pytest *)"
|
||||||
|
|
||||||
|
# Optional: Skip review for certain conditions
|
||||||
|
# if: |
|
||||||
|
# !contains(github.event.pull_request.title, '[skip-review]') &&
|
||||||
|
# !contains(github.event.pull_request.title, '[WIP]')
|
||||||
|
|
65
.github/workflows/claude.yml
vendored
Normal file
65
.github/workflows/claude.yml
vendored
Normal file
|
@ -0,0 +1,65 @@
|
||||||
|
name: Claude Code
|
||||||
|
|
||||||
|
on:
|
||||||
|
issue_comment:
|
||||||
|
types: [created]
|
||||||
|
pull_request_review_comment:
|
||||||
|
types: [created]
|
||||||
|
issues:
|
||||||
|
types: [opened, assigned]
|
||||||
|
pull_request_review:
|
||||||
|
types: [submitted]
|
||||||
|
|
||||||
|
jobs:
|
||||||
|
claude:
|
||||||
|
if: |
|
||||||
|
(github.event_name == 'issue_comment' && contains(github.event.comment.body, '@claude')) ||
|
||||||
|
(github.event_name == 'pull_request_review_comment' && contains(github.event.comment.body, '@claude')) ||
|
||||||
|
(github.event_name == 'pull_request_review' && contains(github.event.review.body, '@claude')) ||
|
||||||
|
(github.event_name == 'issues' && (contains(github.event.issue.body, '@claude') || contains(github.event.issue.title, '@claude')))
|
||||||
|
runs-on: ubuntu-latest
|
||||||
|
permissions:
|
||||||
|
contents: read
|
||||||
|
pull-requests: read
|
||||||
|
issues: read
|
||||||
|
id-token: write
|
||||||
|
actions: read # Required for Claude to read CI results on PRs
|
||||||
|
steps:
|
||||||
|
- name: Checkout repository
|
||||||
|
uses: actions/checkout@v4
|
||||||
|
with:
|
||||||
|
fetch-depth: 1
|
||||||
|
|
||||||
|
- name: Run Claude Code
|
||||||
|
id: claude
|
||||||
|
uses: anthropics/claude-code-action@beta
|
||||||
|
with:
|
||||||
|
anthropic_api_key: ${{ secrets.ANTHROPIC_API_KEY }}
|
||||||
|
|
||||||
|
# This is an optional setting that allows Claude to read CI results on PRs
|
||||||
|
additional_permissions: |
|
||||||
|
actions: read
|
||||||
|
|
||||||
|
# Optional: Specify model (defaults to Claude Sonnet 4, uncomment for Claude Opus 4)
|
||||||
|
# model: "claude-opus-4-20250514"
|
||||||
|
|
||||||
|
# Optional: Customize the trigger phrase (default: @claude)
|
||||||
|
# trigger_phrase: "/claude"
|
||||||
|
|
||||||
|
# Optional: Trigger when specific user is assigned to an issue
|
||||||
|
# assignee_trigger: "claude-bot"
|
||||||
|
|
||||||
|
# Optional: Allow Claude to run specific commands
|
||||||
|
allowed_tools: "Bash(ansible-playbook * --syntax-check),Bash(ansible-lint *),Bash(ruff check *),Bash(yamllint *),Bash(shellcheck *),Bash(python -m pytest *)"
|
||||||
|
|
||||||
|
# Optional: Add custom instructions for Claude to customize its behavior for your project
|
||||||
|
custom_instructions: |
|
||||||
|
Follow Algo's security-first principles
|
||||||
|
Be conservative with dependency updates
|
||||||
|
Run ansible-lint, ruff, yamllint, and shellcheck before suggesting changes
|
||||||
|
Check the CLAUDE.md file for project-specific guidance
|
||||||
|
|
||||||
|
# Optional: Custom environment variables for Claude
|
||||||
|
# claude_env: |
|
||||||
|
# NODE_ENV: test
|
||||||
|
|
294
CLAUDE.md
Normal file
294
CLAUDE.md
Normal file
|
@ -0,0 +1,294 @@
|
||||||
|
# CLAUDE.md - LLM Guidance for Algo VPN
|
||||||
|
|
||||||
|
This document provides essential context and guidance for LLMs working on the Algo VPN codebase. It captures important learnings, patterns, and best practices discovered through extensive work with this project.
|
||||||
|
|
||||||
|
## Project Overview
|
||||||
|
|
||||||
|
Algo is an Ansible-based tool that sets up a personal VPN in the cloud. It's designed to be:
|
||||||
|
- **Security-focused**: Creates hardened VPN servers with minimal attack surface
|
||||||
|
- **Easy to use**: Automated deployment with sensible defaults
|
||||||
|
- **Multi-platform**: Supports various cloud providers and operating systems
|
||||||
|
- **Privacy-preserving**: No logging, minimal data retention
|
||||||
|
|
||||||
|
### Core Technologies
|
||||||
|
- **VPN Protocols**: WireGuard (preferred) and IPsec/IKEv2
|
||||||
|
- **Configuration Management**: Ansible (currently v9.x)
|
||||||
|
- **Languages**: Python, YAML, Shell, Jinja2 templates
|
||||||
|
- **Supported Providers**: AWS, Azure, DigitalOcean, GCP, Vultr, Hetzner, local deployment
|
||||||
|
|
||||||
|
## Architecture and Structure
|
||||||
|
|
||||||
|
### Directory Layout
|
||||||
|
```
|
||||||
|
algo/
|
||||||
|
├── main.yml # Primary playbook
|
||||||
|
├── users.yml # User management playbook
|
||||||
|
├── server.yml # Server-specific tasks
|
||||||
|
├── config.cfg # Main configuration file
|
||||||
|
├── requirements.txt # Python dependencies
|
||||||
|
├── requirements.yml # Ansible collections
|
||||||
|
├── roles/ # Ansible roles
|
||||||
|
│ ├── common/ # Base system configuration
|
||||||
|
│ ├── wireguard/ # WireGuard VPN setup
|
||||||
|
│ ├── strongswan/ # IPsec/IKEv2 setup
|
||||||
|
│ ├── dns/ # DNS configuration (dnsmasq, dnscrypt)
|
||||||
|
│ ├── ssh_tunneling/ # SSH tunnel setup
|
||||||
|
│ └── cloud-*/ # Cloud provider specific roles
|
||||||
|
├── library/ # Custom Ansible modules
|
||||||
|
├── playbooks/ # Supporting playbooks
|
||||||
|
└── tests/ # Test suite
|
||||||
|
└── unit/ # Python unit tests
|
||||||
|
```
|
||||||
|
|
||||||
|
### Key Roles
|
||||||
|
- **common**: Firewall rules, system hardening, package management
|
||||||
|
- **wireguard**: WireGuard server/client configuration
|
||||||
|
- **strongswan**: IPsec server setup with certificate generation
|
||||||
|
- **dns**: DNS encryption and ad blocking
|
||||||
|
- **cloud-\***: Provider-specific instance creation
|
||||||
|
|
||||||
|
## Critical Dependencies and Version Management
|
||||||
|
|
||||||
|
### Current Versions (MUST maintain compatibility)
|
||||||
|
```
|
||||||
|
ansible==9.2.0 # Stay within 9.x for stability
|
||||||
|
jinja2~=3.1.6 # Security fix for CVE-2025-27516
|
||||||
|
netaddr==1.3.0 # Network address manipulation
|
||||||
|
```
|
||||||
|
|
||||||
|
### Version Update Guidelines
|
||||||
|
1. **Be Conservative**: Prefer minor version bumps over major ones
|
||||||
|
2. **Security First**: Always prioritize security updates (CVEs)
|
||||||
|
3. **Test Thoroughly**: Run all tests before updating
|
||||||
|
4. **Document Changes**: Explain why each update is necessary
|
||||||
|
|
||||||
|
### Ansible Collections
|
||||||
|
Currently unpinned in `requirements.yml`, but key ones include:
|
||||||
|
- `community.general`
|
||||||
|
- `ansible.posix`
|
||||||
|
- `openstack.cloud`
|
||||||
|
|
||||||
|
## Development Practices
|
||||||
|
|
||||||
|
### Code Style and Linting
|
||||||
|
|
||||||
|
#### Python (ruff)
|
||||||
|
```toml
|
||||||
|
# pyproject.toml configuration
|
||||||
|
[tool.ruff]
|
||||||
|
target-version = "py310"
|
||||||
|
line-length = 120
|
||||||
|
|
||||||
|
[tool.ruff.lint]
|
||||||
|
select = ["E", "W", "F", "I", "B", "C4", "UP"]
|
||||||
|
```
|
||||||
|
|
||||||
|
#### YAML (yamllint)
|
||||||
|
- Document start markers (`---`) required
|
||||||
|
- No trailing spaces
|
||||||
|
- Newline at end of file
|
||||||
|
- Quote `'on':` in GitHub workflows (truthy value)
|
||||||
|
|
||||||
|
#### Shell Scripts (shellcheck)
|
||||||
|
- Quote all variables: `"${var}"`
|
||||||
|
- Use `set -euo pipefail` for safety
|
||||||
|
- FreeBSD rc scripts will show false positives (ignore)
|
||||||
|
|
||||||
|
#### Ansible (ansible-lint)
|
||||||
|
- Many warnings are suppressed in `.ansible-lint`
|
||||||
|
- Focus on errors, not warnings
|
||||||
|
- Common suppressions: `name[missing]`, `risky-file-permissions`
|
||||||
|
|
||||||
|
### Git Workflow
|
||||||
|
1. Create feature branches from `master`
|
||||||
|
2. Make atomic commits with clear messages
|
||||||
|
3. Run all linters before pushing
|
||||||
|
4. Update PR description with test results
|
||||||
|
5. Squash commits if requested
|
||||||
|
|
||||||
|
### Testing Requirements
|
||||||
|
|
||||||
|
Before pushing any changes:
|
||||||
|
```bash
|
||||||
|
# Python tests
|
||||||
|
pytest tests/unit/ -v
|
||||||
|
|
||||||
|
# Ansible syntax
|
||||||
|
ansible-playbook main.yml --syntax-check
|
||||||
|
ansible-playbook users.yml --syntax-check
|
||||||
|
|
||||||
|
# Linters
|
||||||
|
ansible-lint
|
||||||
|
yamllint .
|
||||||
|
ruff check .
|
||||||
|
shellcheck *.sh
|
||||||
|
```
|
||||||
|
|
||||||
|
## Common Issues and Solutions
|
||||||
|
|
||||||
|
### 1. Ansible-lint "name[missing]" Warnings
|
||||||
|
- Added to skip_list in `.ansible-lint`
|
||||||
|
- Too many tasks to fix immediately (113+)
|
||||||
|
- Focus on new code having proper names
|
||||||
|
|
||||||
|
### 2. FreeBSD rc Script Warnings
|
||||||
|
- Variables like `rcvar`, `start_cmd` appear unused to shellcheck
|
||||||
|
- These are used by the rc.subr framework
|
||||||
|
- Safe to ignore these specific warnings
|
||||||
|
|
||||||
|
### 3. Jinja2 Template Complexity
|
||||||
|
- Many templates use Ansible-specific filters
|
||||||
|
- Test templates with `tests/unit/test_template_rendering.py`
|
||||||
|
- Mock Ansible filters when testing
|
||||||
|
|
||||||
|
### 4. OpenSSL Version Compatibility
|
||||||
|
```yaml
|
||||||
|
# Check version and use appropriate flags
|
||||||
|
{{ (openssl_version is version('3', '>=')) | ternary('-legacy', '') }}
|
||||||
|
```
|
||||||
|
|
||||||
|
### 5. IPv6 Endpoint Formatting
|
||||||
|
- WireGuard configs must bracket IPv6 addresses
|
||||||
|
- Template logic: `{% if ':' in IP %}[{{ IP }}]:{{ port }}{% else %}{{ IP }}:{{ port }}{% endif %}`
|
||||||
|
|
||||||
|
## Security Considerations
|
||||||
|
|
||||||
|
### Always Priority One
|
||||||
|
- **Never expose secrets**: No passwords/keys in commits
|
||||||
|
- **CVE Response**: Update immediately when security issues found
|
||||||
|
- **Least Privilege**: Minimal permissions, dropped capabilities
|
||||||
|
- **Secure Defaults**: Strong crypto, no logging, firewall rules
|
||||||
|
|
||||||
|
### Certificate Management
|
||||||
|
- Elliptic curve cryptography (secp384r1)
|
||||||
|
- Proper CA password handling
|
||||||
|
- Certificate revocation support
|
||||||
|
- Secure storage in `/etc/ipsec.d/`
|
||||||
|
|
||||||
|
### Network Security
|
||||||
|
- Strict firewall rules (iptables/ip6tables)
|
||||||
|
- No IP forwarding except for VPN
|
||||||
|
- DNS leak protection
|
||||||
|
- Kill switch implementation
|
||||||
|
|
||||||
|
## Platform Support
|
||||||
|
|
||||||
|
### Operating Systems
|
||||||
|
- **Primary**: Ubuntu 20.04/22.04 LTS
|
||||||
|
- **Secondary**: Debian 11/12
|
||||||
|
- **Special**: FreeBSD (requires platform-specific code)
|
||||||
|
- **Clients**: Windows, macOS, iOS, Android, Linux
|
||||||
|
|
||||||
|
### Cloud Providers
|
||||||
|
Each has specific requirements:
|
||||||
|
- **AWS**: Requires boto3, specific AMI IDs
|
||||||
|
- **Azure**: Complex networking setup
|
||||||
|
- **DigitalOcean**: Simple API, good for testing
|
||||||
|
- **Local**: KVM/Docker for development
|
||||||
|
|
||||||
|
### Architecture Considerations
|
||||||
|
- Support both x86_64 and ARM64
|
||||||
|
- Some providers have limited ARM support
|
||||||
|
- Performance varies by instance type
|
||||||
|
|
||||||
|
## CI/CD Pipeline
|
||||||
|
|
||||||
|
### GitHub Actions Workflows
|
||||||
|
1. **lint.yml**: Runs ansible-lint on all pushes
|
||||||
|
2. **main.yml**: Tests cloud provider configurations
|
||||||
|
3. **smart-tests.yml**: Selective test running based on changes
|
||||||
|
4. **integration-tests.yml**: Full deployment tests (currently disabled)
|
||||||
|
|
||||||
|
### Test Categories
|
||||||
|
- **Unit Tests**: Python-based, test logic and templates
|
||||||
|
- **Syntax Checks**: Ansible playbook validation
|
||||||
|
- **Linting**: Code quality enforcement
|
||||||
|
- **Integration**: Full deployment testing (needs work)
|
||||||
|
|
||||||
|
## Maintenance Guidelines
|
||||||
|
|
||||||
|
### Dependency Updates
|
||||||
|
1. Check for security vulnerabilities monthly
|
||||||
|
2. Update conservatively (minor versions)
|
||||||
|
3. Test on multiple platforms
|
||||||
|
4. Document in PR why updates are needed
|
||||||
|
|
||||||
|
### Issue Triage
|
||||||
|
- Security issues: Priority 1
|
||||||
|
- Broken functionality: Priority 2
|
||||||
|
- Feature requests: Priority 3
|
||||||
|
- Check issues for duplicates
|
||||||
|
|
||||||
|
### Pull Request Standards
|
||||||
|
- Clear description of changes
|
||||||
|
- Test results included
|
||||||
|
- Linter compliance
|
||||||
|
- Conservative approach
|
||||||
|
|
||||||
|
## Working with Algo
|
||||||
|
|
||||||
|
### Local Development Setup
|
||||||
|
```bash
|
||||||
|
# Install dependencies
|
||||||
|
pip install -r requirements.txt
|
||||||
|
ansible-galaxy install -r requirements.yml
|
||||||
|
|
||||||
|
# Run local deployment
|
||||||
|
ansible-playbook main.yml -e "provider=local"
|
||||||
|
```
|
||||||
|
|
||||||
|
### Common Tasks
|
||||||
|
|
||||||
|
#### Adding a New User
|
||||||
|
```bash
|
||||||
|
ansible-playbook users.yml -e "server=SERVER_NAME"
|
||||||
|
```
|
||||||
|
|
||||||
|
#### Updating Dependencies
|
||||||
|
1. Create a new branch
|
||||||
|
2. Update requirements.txt conservatively
|
||||||
|
3. Run all tests
|
||||||
|
4. Document security fixes
|
||||||
|
|
||||||
|
#### Debugging Deployment Issues
|
||||||
|
1. Check `ansible-playbook -vvv` output
|
||||||
|
2. Verify cloud provider credentials
|
||||||
|
3. Check firewall rules
|
||||||
|
4. Review generated configs in `configs/`
|
||||||
|
|
||||||
|
## Important Context for LLMs
|
||||||
|
|
||||||
|
### What Makes Algo Special
|
||||||
|
- **Simplicity**: One command to deploy
|
||||||
|
- **Security**: Hardened by default
|
||||||
|
- **No Bloat**: Minimal dependencies
|
||||||
|
- **Privacy**: No telemetry or logging
|
||||||
|
|
||||||
|
### User Expectations
|
||||||
|
- It should "just work"
|
||||||
|
- Security is non-negotiable
|
||||||
|
- Backwards compatibility matters
|
||||||
|
- Clear error messages
|
||||||
|
|
||||||
|
### Common User Profiles
|
||||||
|
1. **Privacy Advocates**: Want secure communications
|
||||||
|
2. **Travelers**: Need reliable VPN access
|
||||||
|
3. **Small Teams**: Shared VPN for remote work
|
||||||
|
4. **Developers**: Testing and development
|
||||||
|
|
||||||
|
### Maintenance Philosophy
|
||||||
|
- Stability over features
|
||||||
|
- Security over convenience
|
||||||
|
- Clarity over cleverness
|
||||||
|
- Test everything
|
||||||
|
|
||||||
|
## Final Notes
|
||||||
|
|
||||||
|
When working on Algo:
|
||||||
|
1. **Think Security First**: Every change should maintain or improve security
|
||||||
|
2. **Test Thoroughly**: Multiple platforms, both VPN types
|
||||||
|
3. **Document Clearly**: Users may not be technical
|
||||||
|
4. **Be Conservative**: This is critical infrastructure
|
||||||
|
5. **Respect Privacy**: No tracking, minimal logging
|
||||||
|
|
||||||
|
Remember: People trust Algo with their privacy and security. Every line of code matters.
|
Loading…
Add table
Reference in a new issue