Lucene - Dev & DevOps

I. S3 Overview 1. Amazon s3 Usecase Backup and storage Disaster recovery Archive Hybird Cloud storage Application hosting Media hosting Data lakes & big data analytics Softeare delivery Static website 2. Amazon S3 - Buckets Amazon S3 allows people to store objects (files) in "buckets" (directories) Buckets must have a globally unique name (across all regions all accounts) Buckets are defined at the region level S3 look like a global service but bucket are created in a region Naming convention No uppercase, No underscore 3-63 characters long Not an IP Must start with lowercase letter or number Must not start with the prefix xn-- Must not end with the suffix -s3alias 3. Amazon S3 - Objects Objects (files) have a key The key is full path: s3://my-bucket/my_file.txt s3://my-bucket/my_folder1/another_folder/my_file.txt The key is composed of prefix + object name s3://my-bucket/my_folder1/another_folder/my_file.txt There's no concept of "directories" within bucket...

What is Amazon VPC? - Amazon Virtual Private Cloud I. VPC & Subnets Primer VPC: private network to deploy your resources (regional resorce) Subnets allow you to partition your network inside your VPC (Availability Zone resource) A public subnet is a subnet that is accessible from the internet A private subnet is a subnet that is not accessible from the internet To define access to the internet and between subnets, we use the Routes Tables VPC Diagram Internet Gateway & NAT Gateways Internet Gateways helps our VPC instances connect with the internet Public Subnets have a route to the internet gateway NAT Gateways (AWS-manged) & NAT instances (self-managed) allow your instances in your Private Subnets to access the internet while remaining private II. NACL, SG, VPC Flow Logs Network ACL & Security Groups NACL (Networl ACL) A firewall which control traffics from and to subnet Can have ALLOW and DENY rules  Are attached at the subnet level  Rules only include IP ad...

  I. What is DNS? Domain Name System which translates the human friendly hostnames into the machine IP address wwwgoogle.com => 172.217.18.36 DNS is the backbone of the internet DNS uses hierarchical naming structure DNS Terminologies Domain Registrar: Amazon Route53, GoDaddy, ... DNS Records: A, AAAA, CNAME, NS, ... Zone file: contains DNS records Name Server: resolves DNS queries ( Authoritative or Non-Authoritative) Top Level Domain (TLD): .com, .us, .in, .gov, .org, ... Second Level Domain (SLD): amazon.com, google.com How DNS Works? II. Route 53 Overview Amazon Route 53 A hightly available, scalable, fully managed and Authoritative DNS Authoritative = the customer (you) can update the DNS records Route 53 is also a Domain Registrar Ability to check the health of your resources The only AWS service which provides 100% availability SLA Why Route 53? 53 is a reference to the tranditional DNS port Route 53 - Records How you want to route traffic for a domain Each record contain...

I.  Amazon RDS Overview RDS stands for Relational Database Services It's managed Database Service for DB use SQL as s Query Language It allows you to create Databases in the cloud that managed byAWS Postgres MySQL Maria DB Oracle Microsoft SQL server Aurora (AWS proprietary database)  Advantage over using RDS versus deploying DB on EC2 RDS is a managed service: Automated provisioning, OS patching Continuous backups and restore to specific timestamp (Point in Time Restore)! Monitoring dashboards Read replicas for improved read performance Multi AZ setup for DR (Disaster Recovery) Maintenance windows for upgrades Scaling capability (verical and horizontal) Storage backed by EBS (gp2 or io1) BUT you can't SSH ino your instances RDS - Storage Auto Scaling Helps you increase storage on your RDS DB instance dynamically When RDS detects you are running out of free database storage, it scales automatically Avoid manually scaling your database storage You have to set Maximun Storage Th...