-
Notifications
You must be signed in to change notification settings - Fork 0
Home
https://aws.amazon.com/training/digital/?cta=tctopbanner
Flashcards https://cloudbite.attejuvonen.fi/
https://gitlab.com/kenichi.shibata/book/ ( Explore gitlab as well )
Welcome to the awsbit wiki! https://aws.amazon.com/certification/coming-soon/ https://aws.amazon.com/new/ https://github.com/awslabs/ https://www.wellarchitectedlabs.com/
https://www.dynamodbbook.com/?preview=true
https://asecure.cloud/p/securevpc/
- App services - Pink
- DB tier and cacheing - light blue
- Storage - green
- web tier/costing - purple
https://wellarchitectedlabs.com/
https://wellarchitectedlabs.com/well-architectedtool/100_labs/contributing/ https://www.duckbillgroup.com/services/aws-cost-optimization/
https://www.metricly.com/view-manage-individual-aws-ec2-costs/
https://docs.aws.amazon.com/acm-pca/latest/userguide/PcaExternalRoot.html
Chad Smith - MOnitoring strategies. https://aws.amazon.com/compliance/hipaa-compliance/ medical data compliance.
https://docs.aws.amazon.com/systems-manager/latest/userguide/session-manager.html https://ec2instances.info/ check iops etc stuff Day 2 chad smith 45 min https://aws.amazon.com/solutions/case-studies/pinterest/ - casestudies check netflix
https://docs.aws.amazon.com/autoscaling/ec2/APIReference/API_AutoScalingGroup.html
=== #Exam guide https://d1.awsstatic.com/training-and-certification/docs-sa-assoc/AWS_Certified_Solutions_Architect_Associate-Exam_Guide_EN_1.8.pdf
Resilience
#SLAs for common services, starting on page 54 https://d1.awsstatic.com/whitepapers/architecture/AWS-Reliability-Pillar.pdf #SLAs for each service can be found here: https://aws.amazon.com//sla
#Single VPC design principles https://aws.amazon.com/answers/networking/aws-single-vpc-design/
#Serverless multi-tier architectures https://d1.awsstatic.com/whitepapers/AWS_Serverless_Multi-Tier_Architectures.pdf
#Route 53 health checks and DNS failover https://docs.aws.amazon.com/Route53/latest/DeveloperGuide/dns-failover.html
#AWS global infrastructure https://aws.amazon.com/about-aws/global-infrastructure/
#Migrating resources from one region to another https://d1.awsstatic.com/whitepapers/aws-migrate-resources-to-new-region.pdf
Performance
#EBS volume types with performance limits https://aws.amazon.com/ebs/features/
#EFS performance https://docs.aws.amazon.com/efs/latest/ug/performance.html
#Optimizing S3 performance https://docs.aws.amazon.com/AmazonS3/latest/dev/optimizing-performance.html
#RDS performance https://docs.aws.amazon.com/AmazonRDS/latest/UserGuide/CHAP_BestPractices.html
#Performance best practices for DynamoDB https://docs.aws.amazon.com/amazondynamodb/latest/developerguide/best-practices.html
#Overview of caching services https://aws.amazon.com/caching/#targetText=In%20computing%2C%20a%20cache%20is,the%20data's%20primary%20storage%20location.
#Example of scaling an infrastructure https://aws.amazon.com/blogs/architecture/scale-your-web-application-one-step-at-a-time/
#Great catalog of launchable solutions in AWS: https://aws.amazon.com/solutions/
Security
#My AWS Security Specialty Cert video! http://www.pearsonitcertification.com/store/aws-certified-security-specialty-complete-video-course-9780135772102
#AWS Organizations FAQ https://aws.amazon.com/organizations/faqs/
#Creating WAF Web ACLs https://docs.aws.amazon.com/waf/latest/developerguide/web-acl.html
#Using Secrets Manager for RDS credentials https://aws.amazon.com/blogs/security/rotate-amazon-rds-database-credentials-automatically-with-aws-secrets-manager/
#AWS Transit Gateway for connecting networks https://aws.amazon.com/transit-gateway/
#VPC security https://docs.aws.amazon.com/vpc/latest/userguide/VPC_Security.html
Cost Optimization
#Service pricing can be found as follows https://aws.amazon.com//pricing
Operational Excellence
#Read the whole whitepaper https://d1.awsstatic.com/whitepapers/architecture/AWS-Operational-Excellence-Pillar.pdf
-
application mgmt blogs -
-
securty blog
-
Python aws
-
aws startup blog --> activate blog 1500 $ can get
-
aws partner blog
-
aws official blog -- > all services blog
-
https://www.aws.training/ ( exam readiness )
-
https://aws.amazon.com/marketplace - solutions made using aws services
-
-
-
- product detail
-
-
-
-
-
- resources
-
-
-
-
-
- faq
-
-
-
-
-
- slas --> VIP must study
-
-
Monthly pdf - https://aws.amazon.com/whitepapers/kindle/?achp_addrcs7
Video from users ( This is my architecture) https://aws.amazon.com/this-is-my-architecture/?achp_addrcs6&tma.sort-by=item.additionalFields.airDate&tma.sort-order=desc
Ramp up guides (PDF with links) https://d1.awsstatic.com/training-and-certification/ramp-up_guides/Ramp-Up_Guide_Architect.pdf?achp_addrcs7
Architecture monthly : https://aws.amazon.com/whitepapers/kindle/?achp_addrcs7
rahu@rahu:$ aws --version
aws-cli/1.18.173 Python/3.8.5 Linux/4.15.0-112-generic botocore/1.19.13
rahu@rahu:$
- Oreilly lectures
- /home/rahu/1working1/tryAWS
- /home/rahu/1working1/anujanagvanshiawsbit
- /home/rahu/1working1/kumaraws
- /home/rahu/1working1/sunilawsbit
- /home/rahu/1working1/SWA
- ~/working1/2237_AWS_ExamCert
https://aws.amazon.com/s3/sla/
Well architected Reliability Pillar WhitePaper Pages 54-58 (https://d1.awsstatic.com/whitepapers/architecture/AWS-Reliability-Pillar.pdf)
This is a new begining https://github.com/rclone/rclone # for syncing various clouds.similar to rsync
What do we want to do with awsbit here. -->
https://www.duckbillgroup.com/aws-super-simple-storage-calculator/
https://github.com/awesomedata/awesome-public-datasets AWS datasets https://registry.opendata.aws/
https://www.awsgeek.com/AWS-History/
https://caylent.com/serverless-ci-cd-on-the-aws-cloud
https://milapneupane.com.np/category/aws/
: - https://aws.amazon.com/blogs/aws/author/jbarr/
https://www.youtube.com/playlist?list=PLxzKY3wu0_FLyzxPid-eKPojeb92xsjL4 https://www.youtube.com/playlist?list=PLxzKY3wu0_FIjhG_6Qyisxk1GccjHV2Fz https://www.youtube.com/playlist?list=PLBGx66SQNZ8a_y_CMLHchyHz_R6-6i-i_ https://www.youtube.com/playlist?list=PLCbzEkWetVXwfPtrQ8CFFEeWFSkIMGuDO https://www.youtube.com/playlist?list=PL9JhaNh5QrVkXwBWfkM1fGI-qxGM-vXGy
try to download the content in text or any file..
http://www.evernote.com/l/AMbHWgriMQ1AB7hy3TAb31p5jD3MSfQn8vA/
http://www.evernote.com/l/AMZGodYcdW9P_LNSX4A8-nxAgZjAI40gaZA/
http://www.evernote.com/l/AMYVwGCZl4pE7b0MgkUvdAmCyUdtOI1kpoY/
http://www.evernote.com/l/AMY6Y-ldCQNK_5eN51v_7kywVV05OgLFl34/
import json import urllib.parse import boto3
print('Loading function')
s3 = boto3.client('s3')
def lambda_handler(event, context): #print("Received event: " + json.dumps(event, indent=2))
# Get the object from the event and show its content type
bucket = event['Records'][0]['s3']['bucket']['name']
# bucket = "mydemo2kelly"
key = urllib.parse.unquote_plus(event['Records'][0]['s3']['object']['key'], encoding='utf-8')
# key = "lambda.rtf"
try:
response = s3.get_object(Bucket=bucket, Key=key)
print("CONTENT TYPE: " + response['ContentType'])
return response['ContentType']
except Exception as e:
print(e)
print('Error getting object {} from bucket {}. Make sure they exist and your bucket is in the same region as this function.'.format(key, bucket))
raise e
import json import urllib.parse import boto3
print('Loading function')
s3 = boto3.client('s3')
def lambda_handler(event, context): #print("Received event: " + json.dumps(event, indent=2))
# Get the object from the event and show its content type
bucket = event['Records'][0]['s3']['bucket']['name']
# bucket = "mydemo2kelly"
key = urllib.parse.unquote_plus(event['Records'][0]['s3']['object']['key'], encoding='utf-8')
# key = "lambda.rtf"
try:
response = s3.get_object(Bucket=bucket, Key=key)
print("CONTENT TYPE: " + response['ContentType'])
return response['ContentType']
except Exception as e:
print(e)
print('Error getting object {} from bucket {}. Make sure they exist and your bucket is in the same region as this function.'.format(key, bucket))
raise e
def lambda_handler(event, context): import boto3
ec2 = boto3.client('ec2', region_name='us-east-1')
response = ec2.describe_instances()
for reservation in response["Reservations"]:
for instance in reservation["Instances"]:
# This sample print will output entire Dictionary object
# This will print will output the value of the Dictionary key 'InstanceId'
print('kumar in')
print(instance["InstanceId"])
print('kumar out')
ids = [instance["InstanceId"]]
ec2.stop_instances(InstanceIds=ids)
# TODO implement
return 'Done'
import json
import boto3
from boto3.session import Session
session = Session(aws_access_key_id='AsfsYZRXV6YGGHMFOLQ',
aws_secret_access_key='TOvtfm5sdasdsadW7NYGX3kkad+Hf',
region_name='ap-south-1')
dynamodb = session.resource("dynamodb")
table = dynamodb.Table('movielist')
##with open('C:\Python27\projects\moviedata.json') as data_file:
with open('C:\Python27\projects\moviedata.json') as json_file:
data = json.load(json_file)
for p in data:
print('Name: ' + str(p['year']))
print('Website: ' + p['title'])
if 'directors' in p['info']:
slistdir = p['info']['directors']
sdirectors = ','.join(slistdir)
print ('Directors: ' + sdirectors)
else:
sdirectors = "null"
if 'release_date' in p['info']:
print ('Release dates:' + p['info']['release_date'])
sreleasedate = str(p['info']['release_date'])
else:
sreleasedate = "null"
if 'rating' in p['info']:
print ('rating:' + str(p['info']['rating']))
srating = str(p['info']['rating'])
else:
srating = "null"
table.put_item(
Item={
'Movietitle': p['title'],
'yearofrelease': str(p['year']),
'directors': sdirectors,
'releasedate': sreleasedate,
'rating': srating,
}
)
rahu@rahu:~/0del/_working/sunilawsbit/awsbit$
sample.txt from future import print_function
import json import urllib import boto3
print('Loading function')
s3 = boto3.client('s3')
def lambda_handler(event, context): #print("Received event: " + json.dumps(event, indent=2))
# Get the object from the event and show its content type
bucket = event['Records'][0]['s3']['bucket']['name']
key = urllib.unquote_plus(event['Records'][0]['s3']['object']['key'].encode('utf8'))
try:
response = s3.get_object(Bucket=bucket, Key=key)
print("#############################################################")
print(response)
print("CONTENT TYPE: " + response['ContentType'])
print("Key Size is : " + str(response['ContentLength']))
print("Key Name is : " + str(key))
print("Hello..Welcome to AWS Lamba function world. Kumar welcome you.....")
print("#############################################################")
print("calling dynamodb function...")
dynamodb = boto3.resource('dynamodb', region_name='us-east-1')
print("calling dynamodb table...")
table = dynamodb.Table('s3info')
print(table.creation_date_time)
print("Inserting the value..")
try:
response = table.put_item(
Item={
's3objectname': str(key),
'content type': response['ContentType'],
'size': str(response['ContentLength']),
'etag': str(response['ETag'])
})
except ClientError as e:
print(e.response['Error']['Message'])
print("PutItem succeeded:")
return str(response['ContentLength'])
except Exception as e:
print(e)
print('Error getting object {} from bucket {}. Make sure they exist and your bucket is in the same region as this function.'.format(key, bucket))
raise cat lamdbda_Stop_instances.txt
def lambda_handler(event, context): # TODO implement import boto3
ec2 = boto3.client('ec2', region_name='us-east-1')
response = ec2.describe_instances()
for reservation in response["Reservations"]:
for instance in reservation["Instances"]:
# This sample print will output entire Dictionary object
# This will print will output the value of the Dictionary key 'InstanceId'
print('kumar in')
print(instance["InstanceId"])
print('kumar out')
ids = [instance["InstanceId"]]
ec2.stop_instances(InstanceIds=ids)
# TODO implement
return 'Hello from Lambda'
rahu@rahu:~/0del/_working/sunilawsbit/awsbit$
my youtube channel : https://www.youtube.com/channel/UC0qiodlU6wb0Av1dYt-NsKA/videos
https://www.youtube.com/watch?v=0IAPZzGSbME&list=PLDN4rrl48XKpZkf03iYFl-O29szjTrs_O
GeekforGeeks Interviewbit Leetcode
System design https://www.hiredintech.com/classrooms/system-design/lesson/60 HIghScalability. Grokkoing the coding interview.
cat linuxBasicCmd.txt Linux basic commands:
Its OS
Its a kernel --> Core of OS (Between Hardware & Applications)
linus Torvalds Started in 1991 from IBM with MS dos...
First version Came in 1994
Its open source
Distribution --> linux kernal + apps
redhat or others...each have diffrent focus
distrowatch.com
redhat & ubuntu are famous --> both are license based..
centos is free fedora"" debian & 100's
clients
putty xshell
http://linux-training.be/linuxfun.pdf
bash vs shell???
$ (user)vs #(root)
folder structure
/ --> root
/bin --> binaries & executable programs
/etc --> OS System config files..
/home --> Home directories..--> pictures, files.
/opt --> third party tools
/tmp --> temp folder...data is deleted when reboot?
/usr --> user releated programs..
/var --> varible data , log files.
/boot --> For boot OS
/lib --> System libraries
/lib64 --> 64 bit
what is shell?
bash vs shells
commands are case sensitive...
#!/bin/bash
man man ls man curl hit q to quit..
date
whoami
hostname
uname
uname -a --> OS
ping
ifconfig
pwd --> current location
cd --> change diretory
ls --> List ls -l --> List Options
mkdir/rmdir --> create directory
rm
touch --> create a file
touch hello.txt
vi
vi test.txt
press i button to insert
to save the file, press esc button , :wq
cat --> displays content of the file
cat test.txt
cat /etc/hostname
head /etc/passwd --> Read fiesr ten lines...
The head command can also display the first n lines of a file.
head -4 /etc/passwd
tail the tail command will display the last ten lines of a file
tail /etc/services
cp copy
mv copy
find find / -name *.mp3
find / -empty
grep
chmod
chmod 754 myfile https://www.guru99.com/file-permissions.html
echo $x = 10
echo $x
echo $path
jobs
jobs -l jobs -p
jobs -s
useradd kumar
passwd kumar
sudo
df
du -->du estimates and displays the disk space used by files.
tar
tar -cvf tecmint-14-09-12.tar /home/tecmint/
untar
zip/unzip
gzip --> Important
apt-get
Vs
yum install
sleep
sudo lshw
lscpu --> CPU
ps --> process ps -A
ps -u kumar
pstree
Services: service --status-all
kill pid
killall
ps aux ps ax | grep httpd
perf
curl
top
test 10 -gt 55 ; echo $?
#!/bin/bash if [ -f isit.txt ] then echo isit.txt exists! else echo isit.txt not found! fi
rahu@rahu:~/0del/_working/sunilawsbit/awsbit$ cat LinuxVspowershelll.txt https://ss64.com/ps/rahu@rahu:~/0del/_working/sunilawsbit/awsbit$
rahu@rahu:~/0del/_working/sunilawsbit/awsbit$ cat pyhton_samples_list_dict_tuple_files_module.txt
List:
import os fulldirs = os.listdir("C:\Program Files") print type(fulldirs) for ff in fulldirs: print ff
Tuple:
months = ('January','February','March','April','May','June','July','August','September','October','November',' December')
print months[0] print type(months)
Directionary :
phonebook = {'Andrew Parson':8806336, 'Emily Everett':6784346, 'Peter Power':7658344, 'Lewis Lame':1122345} print type(phonebook) print phonebook['Peter Power'] for key, value in phonebook.iteritems(): print key print value
Files:
strparamsfile = "C:\Python27\README.txt" with open(strparamsfile, 'r') as file : filedata = file.read() print filedata
filedata = filedata.replace('xyz', 'abc')
with open(strparamsfile, 'w') as file: file.write(filedata)
Modules & Functions:
Create a file called as testkelly.py
def add(x, y): print "we are calling the addition function" return x + y
def sub(x, y): print "we are calling the sub function" return x - y
def divide(x, y): print "we are calling the addition function" return x / y
Then type --> import testkelly
print testkelly.add(3,7)
cat S3_iamuser_permission_policy.txt { "Version": "2012-10-17", "Statement": [ { "Sid": "Example permissions", "Effect": "Allow", "Principal": { "AWS": "arn:aws:iam::468719736074:root" }, "Action": [ "s3:GetBucketLocation", "s3:ListBucket" ], "Resource": "arn:aws:s3:::testawskumar" } ] }
cat SQS.txt
import json import boto3 from boto3.session import Session
session = Session(aws_access_key_id='', aws_secret_access_key='', region_name='us-east-1')
sqs = boto3.resource('sqs',region_name='us-east-1')
queue_url = 'https://sqs.us-east-1.amazonaws.com/416227743233/learn'
queue = sqs.get_queue_by_name(QueueName='learn')
response = queue.send_message(MessageBody='Hello Kelly!')