Sunday, April 28, 2013

Things I do on Azure Virtual Machine before starting deployment

Many times Azure Virtual Machine instances have behaved very differently. Once, there was an automatic update which took 4 days non stop to update and in other time the every single setting for the port and firewall was fine, but couldn't do a RD for that instance.


I am writing up this blog post to illustrate what I do every time before start deploying a Virtual Machine Instance.


Things to Do

Turn off Firewall 

Actually each instance has a logical firewall guarding for the port protection, they are operating at the instance level i.e. hypervisor level. In Azure management portal it is under the ENDPOINTS tabs. To enable communication to the instance via a particular port, it is mandatory to open the port here in the portal. We will specify the a friendly name to identify the endpoint, the protocol [ TCP, UDP ] and the port / port range.



This guard is sufficient and effective for the instances. By default the Windows firewall is active and we need add the port or program in firewall's exception to enable access. So with all the basic settings in place, in order to setup and web server using IIS, one must open the ENDPOINT 80 TCP in the Azure Management Portal, then again in Windows Firewall. This essentially means that we are doing the same redundant operation at various levels. 

Having the entire security setting in a single place is good enough. So I turn off the firewall and leave the PORT security responsibility at the hypervisor level.

Turn off IE Enhanced Security

I have written a separate blog post to Solving IE Content Block Alert in Windows Server. It is quite annoying for an administrator to keep adding ever single URL to exception before accessing the site. One can turn off of the IE Enhanced Security setting during the deployment and later turn on the Security Setting again if required

Turn off automatic updates

By default the automatic updates are turned on which means the instance can search & acquire for the Windows Update anytime and then install and restart. This puts the instance in a risk of downtime and not accessibility for a period of time ( actually considerable amount of time/days in my case ).

All administrators are aware of the update process and management however, if the instance is managed or administered by a DevOp this is something to note. Turn off the Windows update, if there is any specific update required, one can always search for a particular update and instance.

It is very risky if the automatic update is turned on and which means if the architecture is deployed on a single instance, during the update process the entire application goes offline during the operation.

Change Private Port to Match Public Ports

There are public port and private ports available in Windows Azure Virtual Machines and this is mainly used in the scenarios of multiple instances / distributed deployments. If the deployment is going to be on single instance, it is better to have the private port same as public port as the default public port as the Windows Azure assigns AFAIK in somewhat like 43421. The port ranges generally lie outside the the organization's firewall limit.

Hope this will be useful for someone who are getting started with Azure Virtual Machines

Wednesday, April 10, 2013

IPL Site Runs out of Amazon Web Services

IPL 20-20 is to Indian Cricket Fans is like Cloud is to Internet. Personally I like IPL, it is fast, short, action packed. It is aimed at entertainment and I feel it is bulls eye on the target.



Moving on the tech aspect in the IPL is the site. The website is something amazing clear design, fast loading, quick update. It was when I did a tracert, I found the results were directed to the ELB of Singapore (Asia Pacific South East data Center). I intend to write a blog post what I found and the list of services used by www.IPLT20.com site.

List of AWS Components observed

  • ELB
  • EC2
  • S3
  • CloudFront
  • AutoScaling
  • Route53

Where is the ELB ?

A tracert - Trace Route (cmd command tool) shows the path of the request route all the way to ELB.

Where is the EC2 ?

With the above screenshot of ELB, it is by extension we can safely assume that there would be EC2 servers running. Along with that the search query in Netcraft's what's my site running tool it returned the netblock owner as Amazon EC2.

Also the Yellow Pipe internet services showed that it runs NGINX

Where is the S3 / CloudFront ?

Actually there many references from the site. The static data, js, css, specific images are being served from S3. The view source showed static1.iplt20.com, static2.iplt20.com, static3.iplt20.com and when tracing them gave out the CloudFront URL.



Where is the Auto Scaling ?

It is perfect common sense to have Auto Scaling in place for the massive setup. 

Where is the Route53 ?

I used an online network look up website Network Tools and did a DNS look up. It returned a nameservers of Route53.

Other AWS Components

Clearly there would be several other AWS components like SNS, SES etc along with empire of databases behind the scenes to accomplish this site's awesomeness.


My Views

Clearly this is a good example of site which can be moved to cloud for it elasticity, availability and so on. Choosing the Singapore data center is for the latency as the target audience would be from India, this could save some hops for the requests.

Wednesday, March 20, 2013

Comparing Dropbox Deploy to Windows Azure Websites and Site44

Deployment / Publishing to Microsoft Windows Azure Websites is extremely simple with WebMatrix, with the additional support to deploy via GitHub, BitBucket, TFS, CodePlex and the new DropBox just make it amazing. This blog post just touches upon the DropBox deploy to the Windows Azure WebSites.



There is a cool service called as Site44, which leverages DropBox to store, sync, and deploy it for free with a limit. The whole service was built on a freemium model. The free ones have a limitation of 100MB out etc. There are more sophisticated options and features available for a pro subscription. Little more info about Site44; Steve Marx is the Founder or Site44 he was Ex-Microsoft Azure Evangelist and currently Chief Windows Azure Architect of Aditi Technologies.

The Comparison


Windows Azure WebsitesSite44
Free Mode
165 MB
100 MB
Free Websites per Subscription
10
5
Content Type
Dynamic - Support for ASP.net, php, node.js
Static
Scaling
Possible using Shared and Reserved Mode
Not Supported
Custom Domain
Available for SHARED & RESERVED modes
FREE
SLA
Available with variations in mode - FREE, SHARED, RESERVED
Not Supported
Data Transfer per month
Pay As you go for SHARED & RESERVED
50 GB, beyond that contact sales@site44.com
Deployment Versions
Supported and similar to GIT like setup
Not Supported
Deployment Update Method
On changes in DropBox, A Manual Sync is required to create a new deployment and then make the deployment the current deployment
Changes in DropBox reflects in the site instantaneously
Password Protected Site ( + https)
Custom implementation
Supported out of the box
Use Cases
Full fledged applications with dynamic content. Open Source software packages like WordPress, Drupal, BlogEngine.net. Special consideration for Scaling as well
Static content, site, blogs, manually updated/update-able sites



Site 44 Intro



DropBox on Windows Azure Websites Intro


Sunday, March 10, 2013

AWS and Azure Global IP Range

I found an interesting piece of information about IP (IPv4) ranges for the world's top cloud providers viz Amazon Web Services and Microsoft Windows Azure. These information are from their official site and I am just mashing up them into this blog post.

Source : Wikipedia

Amazon Web Services 

For vast majority of services offered by AWS like S3, SQS, SNS, DynomoDB, RDS and so on, they provide an URL access. I suppose, only EC2 is the service which can be accessed via IP or the context custom IP comes into the picture, although IP is not being provided for all the EC2 instances. Even for EC2, AWS provides URL access caleed Public DNS to access the EC2 instance. It is Elastic IP which provides IP provisioning.

For the services like VPC, one can specify custom IP based on the subnet's, convention etc, but those IP are more like private IPs with in the VPC, again we need the Elastic IP to gain access to over the public internet or Elastic Load Balance (ELB).

Here is the list of consolidation of the IP Ranges across all the AWS Regions.


US East - Viginia
72.44.32.0/19 72.44.32.0 - 72.44.63.255
67.202.0.0/18 67.202.0.0 - 67.202.63.255
75.101.128.0/17 75.101.128.0 - 75.101.255.255
174.129.0.0/16 174.129.0.0 - 174.129.255.255
204.236.192.0/18 204.236.192.0 - 204.236.255.255
184.73.0.0/16 184.73.0.0 – 184.73.255.255
184.72.128.0/17 184.72.128.0 - 184.72.255.255
184.72.64.0/18 184.72.64.0 - 184.72.127.255
50.16.0.0/15 50.16.0.0 - 50.17.255.255
50.19.0.0/16 50.19.0.0 - 50.19.255.255
107.20.0.0/14 107.20.0.0 - 107.23.255.255
23.20.0.0/14 23.20.0.0 – 23.23.255.255
54.242.0.0/15 54.242.0.0 – 54.243.255.255
54.234.0.0/15 54.234.0.0 – 54.235.255.255
54.236.0.0/15 54.236.0.0 – 54.237.255.255
US West (Oregon)
50.112.0.0/16 50.112.0.0 - 50.112.255.255
54.245.0.0/16 54.245.0.0 – 54.245.255.255
US West (Northern California)
204.236.128.0/18 204.236.128.0 - 204.236.191.255
184.72.0.0/18 184.72.0.0 – 184.72.63.255
50.18.0.0/16 50.18.0.0 - 50.18.255.255
184.169.128.0/17 184.169.128.0 - 184.169.255.255
54.241.0.0/16 54.241.0.0 – 54.241.255.255
EU (Ireland)
79.125.0.0/17 79.125.0.0 - 79.125.127.255
46.51.128.0/18 46.51.128.0 - 46.51.191.255
46.51.192.0/20 46.51.192.0 - 46.51.207.255
46.137.0.0/17 46.137.0.0 - 46.137.127.255
46.137.128.0/18 46.137.128.0 - 46.137.191.255
176.34.128.0/17 176.34.128.0 - 176.34.255.255
176.34.64.0/18 176.34.64.0 – 176.34.127.255
54.247.0.0/16 54.247.0.0 – 54.247.255.255
54.246.0.0/16 54.246.0.0 – 54.246.255.255
Asia Pacific (Singapore)
175.41.128.0/18 175.41.128.0 - 175.41.191.255
122.248.192.0/18 122.248.192.0 - 122.248.255.255
46.137.192.0/18 46.137.192.0 - 46.137.255.255
46.51.216.0/21 46.51.216.0 - 46.51.223.255
54.251.0.0/16 54.251.0.0 – 54.251.255.255
Asia Pacific (Sydney)
54.252.0.0/16 54.252.0.0 – 54.252.255.255
Asia Pacific (Tokyo)
175.41.192.0/18 175.41.192.0 - 175.41.255.255
46.51.224.0/19 46.51.224.0 - 46.51.255.255
176.32.64.0/19 176.32.64.0 - 176.32.95.255
103.4.8.0/21 103.4.8.0 - 103.4.15.255
176.34.0.0/18 176.34.0.0 - 176.34.63.255
54.248.0.0/15 54.248.0.0 - 54.249.255.255
South America (Sao Paulo)
177.71.128.0/17 177.71.128.0 - 177.71.255.255
54.232.0.0/16 54.232.0.0 – 54.232.255.255

Microsoft Windows Azure

There aren't much thing on IP in Windows Azure currently. Windows Azure Virtual Machines came recently when compared to Amazon Web Services's EC2, perhaps Microsoft Azure is working on more features and sophisticated components for Azure Virtual Machines. During the creation process of an Azure Virtual Machine we are free to pick a DNS name (URL) to access and the public IP (VIP - Virtual IP) is auto assigned.

Just like we have VPC, Azure provides Azure Virtual Networks and gives us the ability to fix the IP under a subnet, but still the IP is auto assigned following the subnet pattern. This IP remains internal and used in to things domain join, integrate Active Directory etc. for all external access we can access it via VIP or DNS (MyAzureVM.cloudapp.net).

Europe - North Europe
213.199.160.0/20
213.199.184.0/21
157.55.230.160/27
157.55.3.0/24
168.61.96.0/19
168.63.32.0/19
168.63.64.0/20
168.63.80.0/21
168.63.92.0/22
65.52.224.0/22
65.52.228.0/22
65.52.248.0/21
65.52.64.0/20
94.245.104.0/21
94.245.112.0/20
94.245.88.0/21
Europe - West Europe
157.55.10.0/27
157.55.10.32/27
157.55.10.64/26
157.55.12.0/28
157.55.9.112/28
157.55.8.128/28
157.55.8.144/28
157.55.8.160/28
157.55.8.64/26
168.63.0.0/19
168.63.96.0/19
213.199.128.0/21
213.199.136.0/22
213.199.180.112/28
213.199.180.192/26
213.199.180.32/28
213.199.180.96/28
213.199.183.0/24
65.52.128.0/19
94.245.97.0/24
Asia - East Asia
100.80.0.0/17
111.221.64.0/22
111.221.69.0/25
168.63.128.0/19
168.63.192.0/19
207.46.67.160/27
207.46.67.192/27
207.46.72.0/26
207.46.77.224/28
207.46.87.0/24
207.46.89.16/28
207.46.95.32/27
65.52.160.0/19
Asia - South East Asia
111.221.16.0/21
111.221.80.0/20
111.221.96.0/20
137.116.128.0/19
168.63.160.0/19
168.63.224.0/19
207.46.48.0/20
USA - South Central US
157.55.103.32/28
157.55.103.48/28
157.55.153.224/28
157.55.176.0/20
157.55.192.0/22
157.55.196.0/22
157.55.200.0/22
157.55.80.0/22
157.55.84.0/22
168.62.128.0/19
65.52.32.0/21
65.54.48.0/21
65.55.64.0/20
65.55.80.0/20
70.37.160.0/21
70.37.48.0/20
70.37.64.0/18
USA - North Central US
157.55.136.0/21
157.55.151.0/28
157.55.160.0/20
157.55.208.0/21
157.55.216.0/22
157.55.220.0/22
157.55.24.0/21
157.55.252.0/22
157.55.60.224/28
157.55.60.240/28
157.55.73.32/28
157.56.12.0/22
157.56.24.160/28
157.56.24.176/28
157.56.24.192/28
157.56.28.0/22
157.56.8.0/22
168.62.224.0/20
168.62.96.0/19
207.46.192.0/20
209.240.220.0/23
65.52.0.0/19
65.52.106.128/27
65.52.106.16/28
65.52.106.160/27
65.52.106.192/27
65.52.106.224/28
65.52.106.240/28
65.52.106.32/27
65.52.106.64/27
65.52.106.96/27
65.52.107.0/28
65.52.192.0/19
65.52.232.0/22
65.52.236.0/22
65.52.240.0/22
65.52.244.0/22
65.52.48.0/20
USA - East US
65.55.192.0/19
65.55.224.0/19
65.55.96.0/20
157.56.176.0/21
168.61.32.0/20
168.61.48.0/21
168.62.160.0/19
168.62.32.0/19
USA - West US
157.56.160.0/21
168.61.0.0/20
168.61.16.0/21
168.61.24.0/21
168.62.0.0/19
168.62.192.0/20
168.62.208.0/21
168.62.216.0/21


References

Tuesday, March 5, 2013

Getting Started with Amazon RedShift

For many years till now a Data Warehouse was confined to biggies of the industries. It was very difficult for mid sized or smaller companies to think or imagine about data warehouse for various reasons like cost, technology, infrastructure etc. Data Warehouse was considered a luxury for the industries but it not so form now. Amazon has changed the game play.

Server with the characteristics of high performance, high scale, high availability went on to the cloud. This is the period where the data and high volume data will be moved to cloud for easy storage, cost effectiveness, high scale computing and data crunching. In evident to this Amazon Web Services has offered Peta Byte Scale Data WareHouse on Cloud called Amazon RedShift. It was launched in AWS ReInvent event 2012.



Brief Intro About RedShift

  • Peta Byte Scale Data WareHouse
  • Columnar Based
  • MPP - Massively Parallel Processing Architecture
  • Advanced Compression
  • Easy to Scale up or down
  • Connectivity using popular BI and ETL tools like MicroStrategy and JasperSoft
  • Currently available for US-East (Virginia), US-West (Oregon), EU (Ireland)
  • Can be provisioned inside VPC
  • XLarge cluster can be of the size 1(Single Node) to  2 - 16 (Multi-Node Cluster) 
  • 8XLarge can be of the size 2 to 16 (Multi-Node Cluster)
  • Leader node automatically provisioned for entry point contact and operations, apart from the regular nodes
  • Leader node is not charged or doens't come under billing
  • Multi AZ option not available right now
  • Now AZ selection is available All nodes are placed in single AZ but the selection AZ is done by Amazon
  • Can be connected with existing AWS Data Components like Data PipeLine, Elastic Map Reduce, DynomoDB, S3 etc.

Components under the Management Console for RedShift

  • Clusters
  • SnapShots
  • Security Groups
  • Parameter Groups
  • Subnet Groups
  • Reserved Nodes
  • Events

How Powerful is RedShift Cluster

Amazon RedShift comes in 2 node types to provision a Cluster, ExtraLarge node comes with 2 TB of compressed storage with nodes from 1 node to 32 nodes and 8ExtraLarge node comes with 16 TB of compress storage which can be from 2 nodes way up to 100 nodes.

High Storage Extra Large (XL) DW Node:

  • CPU : 2 Virtual Cores - Intel Xeon E5
  • ECU : 4.4
  • Memory : 15 GB
  • Storage : 3 HDD with 2TB of local attached storage
  • Network : Moderate
  • Disk I/O : Moderate
  • API : dw.hs1.xlarge

High Storage Eight Extra Large (8XL) DW Node : 

  • CPU : 16 Virtual Cores - Intel Xeon E5
  • ECU : 35
  • Memory : 120 GB
  • Storage : 24 HDD with 16 TB of local attached storage
  • Network : 10 Gigabit Ethernet with support for placement groups
  • Disk I/O : Very High
  • API : dw.hs1.8xlarge

Cluster with Extra Large Node (XL)

Extra Large Node cluster can be a single node or multi node cluster ranging from 2 to 16 nodes i.e. each of the node will be equipped with the above infra of 15 GB of memory, 2TB of local attached storage etc.


Cluster with Eight Extra Large Node (8XL)


Regarding the 8XL DW it would be multi node cluster ranging from 2 to 100 nodes i.e. each of the node will be equipped with the above infra of 120 GB, 16 TB of local attached storage etc.

PS : The existing management console shows only the node cluster count of minimum of 2 and maximum of 16. Actually you can go beyond 16 and all the way up to 100. Amazon has that explicitly done that to avoid over provisioning. You need to fill in a form / contact Amazon to increase your limit.




Costing

As stated above, Amazon RedShift is currently offered only at US East 1, Virginia Data Center. The pricing is only for that region.

Node SizeCost Per Hour Per Node
XL Node - 2 TB Storage (Per Node)  $0.850
8XL Node - 16 TB Storage (Per Node)  $6.800

Reserved Instance Costing

As Data WareHouses run in legacy for years together it is both sensible and cost effective to have a long term commitment with Amazon Reserved Instance to have cheaper running cost of the clusters.


1 Year Reserved Instance Pricing
Node Upfront Investment Discounted Hourly Running Cost Regular Hourly Running Cost Total Yearly Running Cost with Reserved Capacity Total Yearly Running Cost without Reserved Capacity Annual Savings
XL Large
$2500
$0.215 
$0.850

$4383.40
($2500 + 365 x 24 x $0.215 )
$ 7446
( 365 x 24 x $0.850 )
$3062.60
8XL Large
$20000
$1.720 
$6.800

$35067.20 
($20000 + 365 x 24 x $1.720 )
$ 59568
( 365 x 24 x $6.800 )
$24500.80


3 Year Reserved Instance Pricing
Node Upfront Investment Discounted Hourly Running Cost Regular Hourly Running Cost Total Yearly Running Cost with Reserved Capacity Total Yearly Running Cost without Reserved Capacity Annual Savings
XL Large
$3000
$0.114 
$0.850

$1998.64
($3000/3) + (365 x 24 x $0.215 )
$ 7446
( 365 x 24 x $0.850 )
$5447.36
8XL Large
$24000
$0.912 
$6.800

$15989.12 
($24000/3) + (365 x 24 x $0.912 )
$ 59568
( 365 x 24 x $6.800 )
$43578.88


Scaling in RedShift

To begin with you can start with XL Single Node (supports till 2TB) and grow out to XL Multi Node Cluster till 16 nodes (supports till 2 TB). On reaching the bottleneck of performance or storage, you can always scale out for 8XL instance anytime. All the scaling patterns i.e. count and node size are possible as shown in the diagram.



During the process of the scaling out or scaling in, there would be small time period where the Node Clusters would be in the read only mode and once the new cluster with new infra setting is ready, the cluster will get back to the normal operational state. Essential there is a copy operation performed during the transition from old cluster config to new cluster configuration.

Back Up and Storage

RedShift supports both manual backups and automated / scheduled backups for the node clusters. The back up is placed in S3 - Amazon Simple Storage Service and it can restored to the cluster anytime. With Object expiry in place for S3, you schedule the archival or migration to Amazon Glacier after few days say 30 days. With this the entire setup of RedShift, S3, Glacier becomes full automated and self serviced. 

Connectivity

You can connect to the RedShift via standard JDBC - ODBC tools and drivers like SQL Workbench/J. Amazon has a good documentation of how do that here.

Apart from the regular connectivity, Amazon RedShift has partners for tools support like Actuate, Birst, Jaspersoft, MicroStrategy, Pentaho, Pervasive, tableau, Attunity, Informatica, Talend. Complete list of partners can be found here.



Update

Every thing what wrote above has been made as a SlideShare presentation by Dr.Matt Wood of AWS.


References

Saturday, March 2, 2013

Cost Economics of Amazon SQS and Azure Storage Queue

For any distributed architecture and systems it absolutely incomplete / impossible to build it without a queue. With Cloud driving the computing and architecture to be loosely coupled and queue tie the infrastructures together.

Queue system is indeed very important and both Amazon & Azure have pioneered that during their early entry to the Cloud arena. Amazon came into Amazon Web Services with it first service as SQS - Simple Queue Service in 2004. Actually lot of people think is it S3-Simple Storage Service which is the first offering from AWS, nope it is SQS. During the PDC 2008, Microsoft announced Windows Azure with PaaS infrastructure and Azure Storage Blob, Queue, Table.

Gaurav Mantri has illustrated, well actually investigated about Azure Storage Queue vs Amazon Simple Queue Service. It clearly explain about the various tech specs and capabilities of each of the queues. Here in this post I attempt to explore the cost economics behind it. However in my experience the cost contributing to the overall architecture by the Queues is very less when compared to the compute instances and databases.

Cost Metrics


Azure Storage Queue Amazon Simple Queue Service
In Bandwidth Free Free
Out Bandwidth $0.12 per GB - Up to 10 TB / month, detailed price below $0.120 per GB - Up to 10 TB / month, detailed price below
Storage Cost $0.095 per GB - First 1 TB / Month detailed price below N/A
Transaction Cost $0.01 per 100K Transactions $0.50 per 1000K Transactions (1 Million)

Azure Out Bandwidth details Information


Data Transfer OutboundZone 1 (US & Europe Data Centers)Zone 2 (Asian Data Centers)
First 10 TB / Month$0.12 per GB$0.19 per GB
Next 40 TB / Month$0.09 per GB$0.15 per GB
Next 100 TB / Month$0.07 per GB $0.13 per GB
Next 350 TB / Month$0.05 per GB$0.12 per GB
Beyond 350 TB / MonthContact MicrosoftContact Microsoft

Amazon Out Bandwidth details


Storage US East (N. Virginia)US West (Oregon) US West (Northern California) EU (Ireland) Asia Pacific (Singapore) Asia Pacific (Tokyo) Asia Pacific (Sydney) South America (Sao Paulo)
First 1 GB / month$0.000 per GB$0.000 per GB$0.000 per GB$0.000 per GB$0.000 per GB$0.000 per GB$0.000 per GB$0.000 per GB
Up to 10 TB / month$0.120 per GB$0.120 per GB$0.120 per GB$0.120 per GB$0.190 per GB$0.201 per GB$0.120 per GB$0.250 per GB
Next 40 TB / month$0.090 per GB$0.090 per GB$0.090 per GB$0.090 per GB$0.150 per GB$0.158 per GB$0.090 per GB$0.230 per GB
Next 100 TB / month$0.070 per GB$0.070 per GB$0.070 per GB$0.070 per GB$0.130 per GB$0.137 per GB$0.070 per GB$0.210 per GB
Next 350 TB / month$0.050 per GB$0.050 per GB$0.050 per GB$0.050 per GB$0.120 per GB$0.127 per GB$0.050 per GB$0.190 per GB
Next 524 TB / monthContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact Amazon
Next 4 PB / monthContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact Amazon
Greater than 5 PB / monthContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact AmazonContact Amazon


Cost Information

The above tables illustrated the cost metric during time of posting, the cloud providers Azure and Amazon bring down the pricing at an amazing pace as result of market competition and innovation.

Things Involved in Architecture

Actually the out bandwidth doesn't count when the queue is consumed or accessed by the components in the same data center i.e. Considering there is a SQS in US East - Virginia data center and if the same SQS queue is accessed by EC2 in the same region, there wont any out band width for the SQS queue but there could out band involved for the EC2 instance when accessed outside. This holds the same for Azure Storage Queue as well.

Importance of Queue Explained by AWS



Closer Watch

Azure charges for the both transaction cost and storage cost for the Queue perhaps it is 64K per queue item plus the meta data associated with the queue. Where as the Amazon just charges for the transaction cost alone. Perhaps this is due to the design of the Azure Storage system itself. Based on the paper Windows Azure Storage: A Highly Available Cloud Storage Service with Strong Consistency, it is just an abstraction layer and  Blob, Queue and Table are handled the same way, my guess is it could be the same reason for the costing and management i.e the costing is same for all the 3 queue, blob, table [Transaction + Storage] and also during the creation we create a storage domain and all the queue, table and blob are handled under the same domain space.

References

  1. http://aws.amazon.com/sqs
  2. http://www.windowsazure.com/en-us/develop/net/how-to-guides/queue-service/
  3. http://www.windowsazure.com/en-us/pricing/calculator/?scenario=full
  4. http://aws.amazon.com/sqs/pricing
  5. http://www.windowsazure.com/en-us/pricing/details
  6. http://sigops.org/sosp/sosp11/current/2011-Cascais/printable/11-calder.pdf

Thursday, January 31, 2013

Azure Free Trial - Solving Common Problems and Things to Know

Windows Azure is the Cloud offering from Microsoft in variations of mainly IaaS, PaaS. To try out the Azure all that we need is a credit card and commercial availability in your country. To check for commercial availability click here.

People generally get little uneasy or skeptical to add their credit card to try out Azure, and it is quite a human tendency and this will take a quite a time for people to let go of this mind-set. You can try out Windows Azure for free and no commitments but still they need a credit card attached to the Azure account. After the course of testing for 90 days, there is no restrictions or agreement for you to stay with Azure.

Azure Free Trial - Free Tier

compute / 750 small compute hours per month
web sites / 10 web sites
mobile services / 10 mobile services
relational database / 1 SQL database
SQL reporting / 100 hours per month
storage / 35GB with 50,000,000 storage transactions
data transfer / unlimited inbound & 25GB outbound
media services encoding / 50 GB (input & output combined)
cdn / 20GB outbound with 500,000 transactions
cache / 128MB
service bus / 1,500 relay hours and 500,000 messages


Azure Free Trial - Free Tier


Q1: My country is not listed in the Azure Subscription Portal?


A1:  Windows Azure is currently available in 89 Countries as on Today [31 Jan 2012].
Algeria, Argentina, Australia, Austria, Azerbaijan, Bahrain, Belgium, Brazil, Bulgaria, Canada, Chile, Colombia, Costa Rica, Croatia, Cyprus, Czech Republic, Denmark, Dominican Republic, Ecuador, Egypt, El Salvador, Estonia, Finland, France, Germany, Greece, Guatemala, Hong Kong, Hungary, Iceland, India, Indonesia, Ireland, Israel, Italy, Japan, Jordan, Kenya, Korea, Kuwait, Latvia, Liechtenstein, Lithuania, Luxembourg, Macedonia (FYRO), Malaysia, Malta, Mexico, Montenegro, Morocco, Netherlands, New Zealand, Nigeria, Norway, Oman, Pakistan, Panama, Paraguay, Peru, Philippines, Poland, Portugal, Puerto Rico, Qatar, Romania, Saudi Arabia, Serbia, Singapore, Slovakia, Slovenia, South Africa, Spain, Sri Lanka, Sweden, Switzerland, Taiwan, Thailand, Trinidad & Tobago, Tunisia, UAE, UK, United States, Uruguay, Venezuela, Belarus, Kazakhstan, Turkey, Ukraine and Russia.

If your country is not in the list, these are the things you can do
  • Contact Microsoft about any information about the availability of Azure in your country.
  • Vote your voice in Windows Azure Feature Voting and mainly in the thread Why not available in my country?.
  • Other alternative is to use Credit of your friend or cousin who is from one of the above stated countries.

Few MSDN Forum Threads about this problem


Q2: My free tier account is DISABLED?


A2:  There is a spending limit employed with the free tier account, the sole role of the spending limit is to govern your Azure usage not to exceed the free tier of Azure Free Trial Account offering. You can disable the spending limit and on doing so, on the event of usage exceeding the free tier, your will be charged at normal rates for that month.

Your data is not lost but the account will be disabled and accessible as a read-only mode if you exceed the free tier.

Quotes from the Azure site about spending limit "When your usage exhausts the monthly amounts included in your offer, we will disable your service for the remainder of that billing month, which includes removing any hosted services that you may have deployed. The data in your storage accounts and databases will be accessible in a read-only manner. At the beginning of the next billing month, your subscription will be re-enabled and you can re-deploy your hosted service(s) and have full access to your storage accounts and databases.".

PS: The spending limits are applied by default not only for free tier but also for other partner benefits like BizSpark, MSDN etc.

Few MSDN Forum Threads & StackOverFlow Posts about this problem

3 Months Windows Azure Trial Disabled in 3 Weeks


Q3: Trying Azure without Credit Card?

A3:  I am not sure whether is still available for public use, however Microsoft can provide an Azure account to try without any credit card requirement. Personally, I have used 30 days & 90 days Azure Pass(es) to learn Azure roughly during early 2011. I guess it not available now-a-day i.e. I haven't seen any offering these days. There is actually a site to request for Azure Pass i.e. Azure Trial account with credit card; however not sure whether Microsoft is entertaining now.

Frankly, it just takes less than 5 mins to create an Azure account with your credit card and importantly instant activation as applying for an Azure account will keep you in queue and you have wait for the approval. There were also few Promo Codes, one such was from my friend Paras Doshi and he was offering a Promo Code, please note the date of the article [Jun 27, 2011].

Q4: Unsubscribing From Azure after 90 days


A4: Azure account can be unsubscribed any time during the trial period or post the trial period directly via the portal itself. www.windowsazure.com -> account -> Cancel Subscription.

Earlier, the cancellation of the Azure Subscription would involve contacting Microsoft Azure Support via phone to raise support ticket for canceling subscription. Now it is available on the portal / account settings directly.

Q5: Azure Has deducted $1.00 while signing up



A4: When I signed up for Azure account with my Credit Card, I was charged $1.00 just for signing up. It was credited back. This happened to me. I believe this was just to verify the credit card is fit for transactions. However, I haven't seen above words in any of the site or MSDN.

Conclusion

Please do not hesitate use the Azure Free Trial. Azure support is always there to help you out.

Hope this helps
Naveen