Retrieve bird sightings from a website
Parse the records and save into a DynamoDB
Read the daily results from the DynamoDB
Done as a project to learn AWS for associate developer exam.
From parent directory. Build the jar via maven.
mvn clean install
Update existing the Lambda with the new jar.
aws lambda update-function-code --function-name birdus --zip fileb://./target/birdus-1.0-SNAPSHOT.jar
Invoke the Lambda.
aws lambda invoke --function-name birdus --log-type Tail outfile
The LogResult is returned in Base64 so will need to be decoded.
Simple Java web scraper parsing a table of results for bird sightings.
Stores the results of the day into DynamoDB or S3.
Kicked off every night as a cron job via CloudWatch Events.
reference, date, commonName, county, location, count Main Table
| Partition Key | Sort Key | other attributes |
|---|---|---|
| reference | date | commonName, county, location, count |
A secondary index to improve the querying for date, county and bird name
| Partition Key | Sort Key | other attributes |
|---|---|---|
| date | county | commonName, location, count, reference |
Improvements can be made by indexing on date and .
Set up to monitor costs with alarms set if costs rise.
Kick starts the HTML Parser Lambda on a cron job.
Correct Roles created for each Service, not sharing Policies.
IAM Policies should be created using Least Privilege Principle.
Perform CRUD operations onto the DynamoDB.
GET and POST of a Birds and Locations resources.
Infrastructure as Code
aws cloudformation package --s3-bucket birdus-code-sam --template-file template.yaml --output-template-file generated/output.yaml
aws cloudformation deploy --template-file generated/output.yaml --stack-name birdus-sam --capabilities CAPABILITY_IAM
Allow anonymous users to submit bird sightings.
Use Federated Identities instead of the signup/signin functionality of User Pools.
Each set of user sightings is held for verification by an admin as batched by user.
Added a buildspec.yml to root directory.
- Installs Java8 and maven
- Checkouts master branch
- Performs a maven clean packge
- Takes the target jar and publishes to Lambda
- Saves the jar to s3
- Caches to .m2 folder into S3 for faster build times on next runs
Eh why use this instead of nice old Jenkins & the plugins..