Find Jobs
Hire Freelancers

Write some Software

£20-250 GBP

En curso
Publicado hace más de 7 años

£20-250 GBP

Pagado a la entrega
Write a AWS cloudformation script to create a working Hadoop / Spark environment with yarn Zeplin and Sqoop Basically take 1 2, or 3 i2.4xlarge and setup so it distributes data and work across the machines. I do not want an EMR solution or a solution that has licensing costs. I just want to pay for the EC2 and S3 costs. Also only use Community AMI's NB an 2.4xlarge has 4*800G SSD On each machine use N-1 SSDs (3 in this case) and split each disk roughly between HDFS and Spark. You can use the the final disk for OS and installed software cloudformation Inputs would be number of machines : 1 2 or 3 cloudformation output section will have 4 URLs / port number for: yarn zepplin, ganglia and spark master You can assume I am using my root account, it is a clean environment and I have foxyproxy like tool running on my desktop. You can hard code region and AMI. I will own the copyright of the script. You cannot share it or blog about it or utube it … The requirement is single yaml or json such that I load it to S3 and I simply run cloudformation. Payment if meets all the stated requirements
ID del proyecto: 13141301

Información sobre el proyecto

8 propuestas
Proyecto remoto
Activo hace 7 años

¿Buscas ganar dinero?

Beneficios de presentar ofertas en Freelancer

Fija tu plazo y presupuesto
Cobra por tu trabajo
Describe tu propuesta
Es gratis registrarse y presentar ofertas en los trabajos
Adjudicado a:
Avatar del usuario
Hello, I am applying for this job because I've a keen interest in BigData technology and I’m considering your job post for me with the required capabilities. I have learned R programming, Hadoop and its components Hive, Pig, Sqoop, Flume, HDFS and MapReduce by self and have a very good understanding in all these Concepts. I had attempted Hortonworks Data Platform certified developer - Hadoop certification (HDPCD) on 4th Nov 2016. I also have a good knowledge of Java, Linux, MySql, Python and Android. I believe my capabilities would be perfect for your project. I can complete this job within the necessary period.I will be offering you with all my effort and capabilities. We can have our communication on any of your preferred communication medium. My skype ID is akshay_naidu.9 and I can provide my email ID on chat. We can discuss there in details, if you are interested. I wish you'd give me this chance. Hoping for a long term association. Thank you for taking the time to consider this application and I look forward to hearing from you. Yours sincerely Akshay Naidu
£100 GBP en 8 días
4,8 (5 comentarios)
3,1
3,1
8 freelancers están ofertando un promedio de £261 GBP por este trabajo
Avatar del usuario
Hi There I understand you need a Cloudformation Script(YAML/JSON) to orchestrate the mentioned resource with an Open Source EMR Solution. I'm pretty sure I can do it coz I've been regularly using CFN to orchestrate LAMBDA & API GATEWAY. So I'm familiar with it's workflow and all the constructs the CFN provides. BTW I'm a super expert in AWS. I've been dealing with all aspects of AWS for the past 4 years. You can have a look at my profile to view my past AWS experience. https://www.freelancer.com/u/joystick220.html Thanks Joy
£333 GBP en 3 días
4,9 (63 comentarios)
6,6
6,6
Avatar del usuario
Amazon Web Services: Lambda, API Gateway, EC2, Load Balancers, RDS, Elastic Beanstalk, Elastic File System, IAM, VPC, Security Groups, Cloud Formation,, S3, CLoudFront, Redshift, Route 53, Cloud Watch, Kinesis, SNS, SQS and etc. Advertising Technologies: Facebook Graph API's, FB Website Custom Audience, FB Dynamic Product Ads, Real Time Bidding, Retargeting Ads. Programming Languages: C, C++, Java, Go Big Data Technologies: Kafka, Flume, Pig, Memsql, Aerospike, Redis, MemCache and etc. Miscellaneous: Algorithms, Data Structures, Distributed Systems, Operating Systems Databases: Oracle, MySQL, Operating Systems: Windows, Linux, Ubuntu and etc. Web Technologies: HTML, PHP Code Deployments: Puppet, Docker Monitoring: Nagios, Ganglia
£399 GBP en 0 día
5,0 (33 comentarios)
5,7
5,7
Avatar del usuario
Hello, I want to show you all relevant Demo and Designs which is similar to your project completed previously. To make sure about the requirement set and customizations, I want to discuss this project with you further on personal chat. Let me know the best suitable time for you to schedule the meeting, Feel free to message me at any time, I use to be online 24x7 on Freelancer so probably you will get a quick response from my end. Following are my Expertise Area: 1)PHP with CodeIgniter and Laravel Framework. 2)Node JS 3)Angular JS 4)Mobile App Development Thank
£515 GBP en 10 días
5,0 (1 comentario)
4,4
4,4
Avatar del usuario
I am a data science engineer with 3+ years experience in designing, developing and implementing machine learning solutions to complex data problems. My expertise includes apache-spark, apache Hadoop, AWS, Cloudera, Scala, R, Python and JAVA, data mining. Big Data Experience I have worked in Big Data industry for a couple of years and implemented solutions to real world problems. I can implement data mining CRISP Model starting from business understanding, data exploring, data cleansing, data understanding, data analyzing, building a machine learning model, evaluating a model and then deployment of the model. I can provide you, the best analytical solutions to your data mining problems in R, Python, and scala for small and large data set. If your data does not fit into one machine, means it is big data then I can build a solution for you using big data technologies like apache Hadoop, Apache Spark and related tools and technologies. Let's work together and conquer the world of data. The Tools and technologies that I use most include Apache Spark, PySpark, SparkML, SparkR, RStudio, PyDev, Scala, Python, R and Java. Cloud Experience I have worked on different cloud provider platforms including AWS, digital-ocean and on-premise. I can deploy and monitor a Hadoop and spark cluster on any of the cloud provider mentioned above. VISIT PROFILE FOR SATISFACTION THANKS
£166 GBP en 3 días
5,0 (8 comentarios)
3,7
3,7
Avatar del usuario
Hello, We have accomplished 90% of the project which is similar of your requirement. All we need 10% customization as per your requirement set and specifications. I want to discuss in personal chat in order to explore your needs, which will yield a clear picture of implementation phase. Prior undertaking project, I want to show demo of the work done previously. Apart from demo, I will be sharing following documentation which will turn your project into Quality and Successful delivery: - Technical Project Proposal - Designs - Flow chart for this Project - Execution plan
£257 GBP en 10 días
4,0 (1 comentario)
4,1
4,1
Avatar del usuario
· Setup/Managing Linux Servers on Amazon ( EC2, EBS, ELB, SSL, Security Groups, RDS and IAM). · Setup/Managing VPC, Subnets; make connection between different zones; Blocking suspicious ip/subnet via ACL. · Setup/Managing CDN on Amazon CloudFront ( Origin Path: Server / S3) to improve site performance. · Create/Managing buckets on S3 (CLI) and store db and logs backup, upload images for CDN serve. · Setup/Managing Databases on Amazon RDS. Monitoring servers thorough Amazon CloudWatch, SNS. · Creating/Managing DNS records on Amazon Route 53 and go-daddy panel. · Creating/Managing AMI/Snapshots/Volumes, Upgrade/downgrade AWS resources (CPU, Memory, EBS) · Creating AWS Instances and Resources Bills.
£150 GBP en 3 días
5,0 (1 comentario)
2,0
2,0
Avatar del usuario
Hello I have 7+ years experience in Linux and a very good expertise in AWS and docker containers. I can be able to do this project with great expertise. Regards Subin
£166 GBP en 3 días
0,0 (0 comentarios)
0,0
0,0

Sobre este cliente

Bandera de UNITED KINGDOM
United Kingdom
5,0
3
Forma de pago verificada
Miembro desde ago 31, 2012

Verificación del cliente

¡Gracias! Te hemos enviado un enlace para reclamar tu crédito gratuito.
Algo salió mal al enviar tu correo electrónico. Por favor, intenta de nuevo.
Usuarios registrados Total de empleos publicados
Freelancer ® is a registered Trademark of Freelancer Technology Pty Limited (ACN 142 189 759)
Copyright © 2024 Freelancer Technology Pty Limited (ACN 142 189 759)
Cargando visualización previa
Permiso concedido para Geolocalización.
Tu sesión de acceso ha expirado y has sido desconectado. Por favor, inica sesión nuevamente.